Article

Evaluation of Large Language Model Performance on the Biomedical Language Understanding and Reasoning Benchmark: Comparative Study

2024-05-17

Abstract excerpt

<h4>Background</h4> The availability of increasingly powerful large language models (LLMs) has attracted substantial interest in their potential for interpreting and generating human-like text for biomedical and clinical applications. However, there are often demands for high accuracy, concerns about balancing generalizability and domain-specificity, and questions about prompting robustness when considering the a...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 68e2b2b8-c65e-5a11-8a60-81b608c110ba
DOI: 10.1101/2024.05.17.24307411

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Evaluation of Large Language Model Performance on the Biomedical Language Understanding and Reasoning Benchmark: Comparative StudyDOI 10.1101/2024.05.17.24307411Read

CLEVER: Clinical Large Language Model Evaluationby Expert ReviewSemantic proximity Read

GatorTron: A Large Language Model for Clinical Natural Language ProcessingSemantic proximity Read

Auditing frontier general-purpose large language models in biomedical tasks: reasoning gains, extraction limits, and benchmark reliabilitySemantic proximity Read

Combining Clinician Expertise with Prompt Engineering enhances Small Language Models Reliability for Cancer Entity Recognition in Electronic Health RecordsSemantic proximity Read

Developing a natural language processing system using transformer-based models for adverse drug event detection in electronic health recordsSemantic proximity Read

How well it works: Benchmarking performance of GPT models on medical natural language processing tasksSemantic proximity Read

Entity-centric evaluation of large language model responses for medical question-answering tasksSemantic proximity Read

Improving clinical expertise in large language models using electronic medical recordsSemantic proximity Read

Adapting LLMs for Biomedical Natural Language Processing: A Comprehensive Benchmark Study on Fine-Tuning MethodsSemantic proximity Read

CARDBiomedBench: A Benchmark for Evaluating Large Language Model Performance in Biomedical ResearchSemantic proximity Read

Me-LLaMA: Medical Foundation Large Language Models for Comprehensive Text Analysis and BeyondSemantic proximity Read

Schema-Grounded Multitask Instruction Fine-tuning for Joint Biomedical Named Entity Recognition and Relation Extraction in PharmacovigilanceSemantic proximity Read