Article

Towards a Holistic Framework for Multimodal Large Language Models in Three-dimensional Brain CT Report Generation

2024-07-03

Abstract excerpt

<title>Abstract</title> <p>Multi-modal large language models (MLLMs) have been given free rein to explore exciting medical applications with a primary focus on radiology report generation. Nevertheless, the preliminary MLLM successful attempts in 2D medical image-text pair captioning are incompetent to reflect the real-world diagnostic challenge in the volumetric 3D anatomy. Toward deploying MLLM for more applica...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 0ae62f55-ce2c-597a-b0c5-6941a8249fc4
DOI: 10.21203/rs.3.rs-4558754/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Towards a Holistic Framework for Multimodal Large Language Models in Three-dimensional Brain CT Report GenerationDOI 10.21203/rs.3.rs-4558754/v1Read

Towards Generalist Foundation Model for RadiologySemantic proximity Read

A Multimodal Vision-text AI Copilot for Brain Disease Diagnosis and Medical ImagingSemantic proximity Read

Developing Generalist Foundation Models from a Multimodal Dataset for 3D Computed TomographySemantic proximity Read

CT Multi-Task Learning with a Large Image-Text (LIT) ModelSemantic proximity Read

A retrospective study of a Chinese vision-language large model for emergency 3D brain CT interpretationSemantic proximity Read

An Open-source Fine-tuned Large Language Model for Radiological Impression Generation: A Multi-reader Performance StudySemantic proximity Read

Merlin: A Vision Language Foundation Model for 3D Computed TomographySemantic proximity Read

A Vision-Language Model with Multi-Granular Knowledge Fusion in Medical ImagingSemantic proximity Read

Two-Stage Synthetic-to-Real Transfer Learning for Automated Mammography Report Generation Using Vision-Language ModelsSemantic proximity Read

A multimodal foundation model for emergency head CT interpretationSemantic proximity Read

Automated Fracture Image Captioning Using Multimodal Vision-Language Models: A Comprehensive Comparative Study on a Clinically Curated DatasetSemantic proximity Read

Risk Aware Prompt-Guided CNN–LLM Framework for Brain MRI Diagnostic Report GenerationSemantic proximity Read