Article

Evaluating reasoning LLMs’ potential to perpetuate racial and gender disease stereotypes in healthcare

2025-08-07

Abstract excerpt

This evaluation of 36,000 clinical vignettes found that next-generation reasoning large language models, o3-mini and DeepSeek-R1, frequently perpetuate racial and gender stereotypes for common medical conditions, indicating that advancements in reasoning do not inherently improve representational fairness.

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 9d294710-db98-5033-be7e-654876a4ea3f
DOI: 10.1101/2025.08.05.25333007

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Evaluating reasoning LLMs’ potential to perpetuate racial and gender disease stereotypes in healthcareDOI 10.1101/2025.08.05.25333007Read

Coding Inequity: Assessing GPT-4’s Potential for Perpetuating Racial and Gender Biases in HealthcareSemantic proximity Read

Bias in Large Language Models for Mental Health: Evidence from Vignette-Based Evaluation Across Nine ModelsSemantic proximity Read

Bias in Large Language Models for Mental Health: Evidence from Vignette-Based Evaluation Across Nine ModelsSemantic proximity Read

Evaluating the AI Potential as a Safety Net for Diagnosis: A Novel Benchmark of Large Language Models in Correcting Diagnostic ErrorsSemantic proximity Read

The Inefficacy of Artificial Intelligence Large Language Models in Healthcare: A Clinical and Statistical PerspectiveSemantic proximity Read

LLM Reasoning Does Not Protect Against Clinical Cognitive Biases - An Evaluation Using BiasMedQASemantic proximity Read

Race, Ethnicity and Their Implication on Bias in Large Language ModelsSemantic proximity Read

LLM-Guided Pain Management: Examining Socio-Demographic Gaps in Cancer vs non-Cancer casesSemantic proximity Read

Evaluating Diagnostic Accuracy and Clinical Reasoning of Multiple Large Language Models in PsychiatrySemantic proximity Read

The Inefficacy of Artificial Intelligence Large Language Models in Healthcare: A Clinical and Statistical PerspectiveSemantic proximity Read

Simulated Reasoning and Self-Verification in Generalist Large Language Models for Psychiatric Diagnostic Performance: Cross-Sectional StudySemantic proximity Read

Sociodemographic Bias in Large Language Model Clinical Trial ScreeningSemantic proximity Read