Article

Developing Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomography

2024-10-28

Abstract excerpt

<title>Abstract</title> <p>While computer vision has achieved tremendous success with multimodal encoding and direct textual interaction with images via chat-based large language models, similar advancements in medical imaging AI—particularly in 3D imaging—have been limited due to the scarcity of comprehensive datasets. To address this critical gap, we introduce CT-RATE, the first dataset that pairs 3D medical im...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: f6b4efb1-01a8-5b96-a680-adf4646af3cd
DOI: 10.21203/rs.3.rs-5271327/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Developing Generalist Foundation Models from a Multimodal Dataset for 3D Computed TomographyDOI 10.21203/rs.3.rs-5271327/v1Read

Merlin: A Vision Language Foundation Model for 3D Computed TomographySemantic proximity Read

Towards Generalist Foundation Model for RadiologySemantic proximity Read

CT Multi-Task Learning with a Large Image-Text (LIT) ModelSemantic proximity Read

Towards a Holistic Framework for Multimodal Large Language Models in Three-dimensional Brain CT Report GenerationSemantic proximity Read

Automated Fracture Image Captioning Using Multimodal Vision-Language Models: A Comprehensive Comparative Study on a Clinically Curated DatasetSemantic proximity Read

A multimodal foundation model for emergency head CT interpretationSemantic proximity Read

A Multimodal Large Language Modelling Deep Learning Framework for the Future PandemicSemantic proximity Read

Astra: a generalizable report generation foundation model for 3D computed tomographySemantic proximity Read

Bridging Medical Imaging and Reports:Learning Radiologist's Nuances via Fine-Grained Multi-Modal AlignmentSemantic proximity Read

Health system learning achieves generalist neuroimaging modelsSemantic proximity Read

A Multimodal Vision-text AI Copilot for Brain Disease Diagnosis and Medical ImagingSemantic proximity Read

A retrospective study of a Chinese vision-language large model for emergency 3D brain CT interpretationSemantic proximity Read