Article

RaTEScore: A Metric for Radiology Report Generation

2024-06-24

Abstract excerpt

This paper introduces a novel, entity-aware metric, termed as Radiological Report (Text) Evaluation (RaTEScore), to assess the quality of medical reports generated by AI models. RaTEScore emphasizes crucial medical entities such as diagnostic outcomes and anatomical details, and is robust against complex medical synonyms and sensitive to negation expressions. Technically, we developed a comprehensive medical NER d...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 2d9442df-1f2e-5746-98b5-71745ffb4fa1
DOI: 10.1101/2024.06.24.24309405

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

RaTEScore: A Metric for Radiology Report GenerationDOI 10.1101/2024.06.24.24309405Read

Improving Information Extraction from Pathology Reports using Named Entity RecognitionSemantic proximity Read

Accurate Clinical Entity Recognition and Code Mapping of Anatomopathological Reports Using BioClinicalBERT Enhanced by Retrieval-Augmented Generation: A Hybrid Deep Learning ApproachSemantic proximity Read

Entity-centric evaluation of large language model responses for medical question-answering tasksSemantic proximity Read

DISCERN: A Clinical Impact-aware Framework for Radiology Report ComparisonSemantic proximity Read

Evaluating Progress in Automatic Chest X-Ray Radiology Report GenerationSemantic proximity Read

A Framework for Extraction of Clinical Information from Radiological Mammography Reports Using Large Language Models and Retrieval Augmented Generation.Semantic proximity Read

Generation and Evaluation of Realistic Synthetic Clinical Progress Notes for Prostate Cancer using Large Language ModelsSemantic proximity Read

Assessing the Impact of Pretraining Domain Relevance on Large Language Models Across Various Pathology Reporting TasksSemantic proximity Read

Evaluation of Large Language Model Performance on the Biomedical Language Understanding and Reasoning Benchmark: Comparative StudySemantic proximity Read

CLEVER: Clinical Large Language Model Evaluationby Expert ReviewSemantic proximity Read

A Clinically-Informed Framework for Evaluating Vision-Language Models in Radiology Report Generation: Taxonomy of Errors and Risk-Aware MetricSemantic proximity Read

EchoGraph System for Automated Quality Assessment of Echocardiography ReportsSemantic proximity Read