Article

The Limits of Prompt Engineering in Medical Problem-Solving: A Comparative Analysis with ChatGPT on calculation based USMLE Medical Questions

2023-08-09

Abstract excerpt

<h4>Background</h4> Prompt engineering significantly improves the performance of Large Language Models (LLMs), including GPT-3.5 and GPT-4. However, its utilization remains largely uncharted in the medical field. <h4>Objective</h4> This research aimed to assess the influence of different prompt engineering strategies on ChatGPT (GPT-3.5) in solving medical problems, specifically focusing on medical calculations an...

Topics

Open a Topic to create a Post that cites this publication.

Genomics and Rare Diseases

Identifiers and source

Literature Corpus work: 331cbcbd-a2c6-5e83-9f0f-eb1cb81d0d49
DOI: 10.1101/2023.08.06.23293710

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

The Limits of Prompt Engineering in Medical Problem-Solving: A Comparative Analysis with ChatGPT on calculation based USMLE Medical QuestionsDOI 10.1101/2023.08.06.23293710Read

Prompt Engineering in Large Language Models for Patient Education: A Systematic ReviewSemantic proximity Read

Assessing the Value of ChatGPT for Clinical Decision Support OptimizationSemantic proximity Read

Performance of ChatGPT on Clinical Medicine Entrance Examination for Chinese Postgraduate in ChineseSemantic proximity Read

Human versus Artificial Intelligence: ChatGPT-4 Outperforming Bing, Bard, ChatGPT-3.5, and Humans in Clinical Chemistry Multiple-Choice QuestionsSemantic proximity Read

Can Large Language Models Provide Emergency Medical Help Where There Is No Ambulance? A Comparative Study on Large Language Model Understanding of Emergency Medical Scenarios in Resource-Constrained SettingsSemantic proximity Read

The Reality of Prompt Engineering: Simplicity Often Outperforms Sophistication in Reasoning TasksSemantic proximity Read

Human versus Artificial Intelligence: ChatGPT-4 Outperforming Bing, Bard, ChatGPT-3.5, and Humans in Clinical Chemistry Multiple-Choice QuestionsSemantic proximity Read

Comparative accuracy of ChatGPT-o1, DeepSeek R1, and Gemini 2.0 in answering general primary care questionsSemantic proximity Read

Evaluation of Prompts to Simplify Cardiovascular Disease Information Using a Large Language ModelSemantic proximity Read

The Scope and Limitations of Extant Research into ChatGPT as a Tool for Patient Education: Systematic ReviewSemantic proximity Read

Recovering Clinical Detail in AI-Generated Responses for Low Back Pain Through Prompt DesignSemantic proximity Read

Beyond Accuracy: Multidimensional Evaluation of Large Language Models in Hepatocellular Carcinoma Management Emphasizing PromptingSemantic proximity Read