Article

Medical concept understanding in large language models is fragmented

2026-03-05

Abstract excerpt

Large language models (LLMs) perform strongly across a wide range of medical applications, yet it remains unclear whether such success reflects genuine understanding of medical concepts. We present an ontology-grounded, concept-centered evaluation of medical concept understanding in LLMs. Using 6,252 phenotype concepts from Human Phenotype Ontology, we decompose concept understanding into three core dimensions—con...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 71c6f021-43c7-590c-afee-e4334a016c80
DOI: 10.64898/2026.03.03.26347552

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Medical concept understanding in large language models is fragmentedDOI 10.64898/2026.03.03.26347552Read

Extraction of Human Phenotype Ontology (HPO) Concepts from Clinical Notes Utilizing Large Language Models (LLM) with Model Context Protocol (MCP)Semantic proximity Read

Systematic benchmarking demonstrates large language models have not reached the diagnostic accuracy of traditional rare-disease decision support toolsSemantic proximity Read

Assessing GPT and DeepL for terminology translation in the medical domain: A comparative study on the human phenotype ontology.Semantic proximity Read

Understanding the Inner Workings of Large Language Models in MedicineSemantic proximity Read

Understanding the Inner Workings of Large Language Models in MedicineSemantic proximity Read

Evaluating a Large Reasoning Model’s Performance on Open-Ended Medical ScenariosSemantic proximity Read

FastHPOCR: pragmatic, fast, and accurate concept recognition using the human phenotype ontology.Semantic proximity Read

Assessing GPT and DeepL for Terminology Translation in the Medical Domain: A Comparative Study on the Human Phenotype OntologySemantic proximity Read

Understanding the Inner Workings of Large Language Models in MedicineSemantic proximity Read

AutoPCR: automated phenotype concept recognition by prompting.Semantic proximity Read

Entity-centric evaluation of large language model responses for medical question-answering tasksSemantic proximity Read

CARDBiomedBench: A Benchmark for Evaluating Large Language Model Performance in Biomedical ResearchSemantic proximity Read