Article

Blueprinting the Future: Automatic Item Categorization using Hierarchical Zero-Shot and Few-Shot Classifiers

2023-12-14

Abstract excerpt

In testing industry, precise item categorization is pivotal to align exam questions with the designated content domains outlined in the assessment blueprint. Traditional methods either entail manual classification, which is laborious and error-prone, or utilize machine learning requiring extensive training data, often leading to model underfit or overfit issues. This study unveils a novel approach employing the ze...

Topics

Open a Topic to create a Post that cites this publication.

Genomics and Rare Diseases

Identifiers and source

Literature Corpus work: 8d7a3697-d273-5653-96e2-9744baffbf30
DOI: 10.21203/rs.3.rs-3740769/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Blueprinting the Future: Automatic Item Categorization using Hierarchical Zero-Shot and Few-Shot ClassifiersDOI 10.21203/rs.3.rs-3740769/v1Read

Performance of Generative Pretrained Transformer on the National Medical Licensing Examination in JapanSemantic proximity Read

Multimodal Large Language Model Passes Specialty Board Examination and Surpasses Human Test-Taker Scores: A Comparative Analysis Examining the Stepwise Impact of Model Prompting Strategies on PerformanceSemantic proximity Read

Evaluating approaches of training a generative large language model for multi-label classification of unstructured electronic health recordsSemantic proximity Read

Evaluation of Large Language Models in Thailand’s National Medical Licensing ExaminationSemantic proximity Read

Performance of Multimodal GPT-4V on USMLE with Image: Potential for Imaging Diagnostic Support with ExplanationsSemantic proximity Read

Performance of progressive generations of GPT on an exam designed for certifying physicians as Certified Clinical DensitometristsSemantic proximity Read

Retrieval-Augmented Claude Opus 4.7 and GPT-5.5 Surpass Human Performance on the Nuclear Cardiology Board Preparation Exam (and Claude Drafts a Paper About it)Semantic proximity Read

Can ChatGPT Pass the 2023 Japanese National Medical Licensing Examination?Semantic proximity Read

A Vision-Language Foundation Model for Zero-shot Clinical Collaboration and Automated Concept Discovery in DermatologySemantic proximity Read

QUEST-AI: A System for Question Generation, Verification, and Refinement using AI for USMLE-Style ExamsSemantic proximity Read

Using a hybrid of artificial intelligence and template-based method in automatic item generation to create multiple-choice questions in medical education: Hybrid AIGSemantic proximity Read

Quality assurance and validity of AI-generated Single Best Answer questionsSemantic proximity Read