Article

Blind Expert Evaluation of Open-Weight LLMs for Thyroid Cancer Patient Education in a Non-English Setting: GPT-OSS-20B vs MedGemma-27B-Instruct

2026-03-13

Abstract excerpt

<title>Abstract</title> <p> <bold>Background:</bold> Non-English and resource-constrained clinical contexts are underrepresented in current large language models (LLM) benchmarking, making it uncertain whether medical specialization improves patient-facing education when models are deployed locally. Open-weight LLMs are increasingly used for patient education, yet it remains unclear whether medical domain speci...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 00405e48-c866-51a0-a143-5afaaf1e93be
DOI: 10.21203/rs.3.rs-8729661/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Blind Expert Evaluation of Open-Weight LLMs for Thyroid Cancer Patient Education in a Non-English Setting: GPT-OSS-20B vs MedGemma-27B-InstructDOI 10.21203/rs.3.rs-8729661/v1Read

Benchmarking the Confidence of Large Language Models in Clinical QuestionsSemantic proximity Read

Performance of OpenAI’s GPT-4 in a mock MRCS Part A ExaminationSemantic proximity Read

ChatGPT Goes to Operating Room: Evaluating GPT-4 Performance and Its Potential in Surgical Education and Training in the Era of Large Language ModelsSemantic proximity Read

Comparative Evaluation of Large Language Models for Medical Education: Performance Analysis in Urinary System Histology.Semantic proximity Read

Performance of Advanced Large Language Models (GPT-4o, GPT-4, Gemini 1.5 Pro, Claude 3 Opus) on Japanese Medical Licensing Examination: A Comparative StudySemantic proximity Read

Benchmarking Large Language Models and Clinicians Using Locally Generated Primary Healthcare Vignettes in KenyaSemantic proximity Read

Comparative Evaluation of ChatGPT-5 and DeepSeek-V3 for Generating Prosthodontic Multiple-Choice Questions: An Expert-Rated StudySemantic proximity Read

Clinical Safety of Large Language Models in Oral Cancer–Related Patient Communication: A Longitudinal StudySemantic proximity Read

Performance of o1 pro and GPT-4 in self-assessment questions for nephrology board renewalSemantic proximity Read

Psychometric Performance and Student Perceptions of AI- versus Human-Generated Multiple-Choice Questions: The AHEAD Randomized Controlled TrialSemantic proximity Read

Comprehensive evaluation of Medtronic’s Butterfly platform, a new audiovisual information material for patient education and shared decision-making in surgical thyroid diseaseSemantic proximity Read

Comparison of Large Language Models’ Performance on Neurosurgical Board Examination QuestionsSemantic proximity Read