Article

Evaluation of a Novel Large Language Model (LLM) Powered Chatbot for Oral-Boards Scenarios

2024-06-01

Abstract excerpt

<h4>Introduction</h4> While previous studies have demonstrated that generative artificial intelligence (AI) can pass medical licensing exams, AI’s role as an examiner in complex, interactive assessments remains unknown. AI-powered chatbots could serve as educational tools to simulate oral examination dialogues. Here, we present initial validity evidence for an AI-powered chatbot designed for general surgery resid...

Topics

Open a Topic to create a Post that cites this publication.

Genomics and Rare Diseases

Identifiers and source

Literature Corpus work: 57ec8493-edc4-5537-a52c-0f44f6bdeea3
DOI: 10.1101/2024.05.31.24308044

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Evaluation of a Novel Large Language Model (LLM) Powered Chatbot for Oral-Boards ScenariosDOI 10.1101/2024.05.31.24308044Read

Human versus Artificial Intelligence: ChatGPT-4 Outperforming Bing, Bard, ChatGPT-3.5, and Humans in Clinical Chemistry Multiple-Choice QuestionsSemantic proximity Read

Strengths and Limitations of Using ChatGPT: A Preliminary Examination of Generative AI in Medical EducationSemantic proximity Read

Evaluating Capabilities of Large Language Models: Performance of GPT4 on Surgical Knowledge AssessmentsSemantic proximity Read

Performance of ChatGPT on free-response, clinical reasoning examsSemantic proximity Read

Human versus Artificial Intelligence: ChatGPT-4 Outperforming Bing, Bard, ChatGPT-3.5, and Humans in Clinical Chemistry Multiple-Choice QuestionsSemantic proximity Read

Comparative Evaluation of Large Language Models for Medical Education: Performance Analysis in Urinary System Histology.Semantic proximity Read

ChatGPT takes the FCPS exam in Internal MedicineSemantic proximity Read

Comparative Performance of Large Language Model-Based Chatbots, Dental Students, and Postgraduate Specialty Students in Text-Based Oral and Maxillofacial Radiology QuestionsSemantic proximity Read

Performance of OpenAI’s GPT-4 in a mock MRCS Part A ExaminationSemantic proximity Read

Protocol For Human Evaluation of Artificial Intelligence Chatbots in Clinical ConsultationsSemantic proximity Read

Is ChatGPT smarter than Otolaryngology trainees? A comparison study of board style exam questionsSemantic proximity Read

Evaluating Chat GPT-4o’s Comparative Performance Over GPT-4 in Japanese Medical Licensing Examination and Its Clinical Partnership PotentialSemantic proximity Read