Article

A Vision-Language Model with Multi-Granular Knowledge Fusion in Medical Imaging

2024-09-20

Abstract excerpt

<title>Abstract</title> <p>The rapid expansion of radiological imaging data has placed a significant burden on radiologists, increasing the risk of diagnostic errors. Vision-language models offer a promising solution to alleviate this workload and improve diagnostic accuracy within the medical imaging domain. However, most current models rely solely on training data to activate general-purpose performance, which...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: c822eb8b-dac6-5655-aa18-f442d58fa437
DOI: 10.21203/rs.3.rs-4950362/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

A Vision-Language Model with Multi-Granular Knowledge Fusion in Medical ImagingDOI 10.21203/rs.3.rs-4950362/v1Read

Towards Generalist Foundation Model for RadiologySemantic proximity Read

Multi-Modal Contextual Reasoning for Neurological Disease Diagnosis with Vision-Language-Tabular TransformersSemantic proximity Read

Bridging Medical Imaging and Reports:Learning Radiologist's Nuances via Fine-Grained Multi-Modal AlignmentSemantic proximity Read

Multimodal Large Language Models are Generalist Medical Image InterpretersSemantic proximity Read

An Adaptive Foundation Model with Evidence-based Clinical Reasoning for GastroenterologySemantic proximity Read

Merlin: A Vision Language Foundation Model for 3D Computed TomographySemantic proximity Read

Enhancing Clinical Reasoning in Medical Vision-Language Model through Structured PromptsSemantic proximity Read

An Empirical Evaluation of Low-Rank Adapted Vision–Language Models for Radiology Medical Image CaptioningSemantic proximity Read

Towards Multimodal Retrieval-Augmented Generation for Medical Visual Question AnsweringSemantic proximity Read

SonoReasoner: Hierarchical Clinical Reasoning for Ultrasound Vision-Language ModelsSemantic proximity Read

MAP-RAG: A Multi-View Adaptive Pattern-Aware Medical Retrieval-Augmented Generation Diagnostic FrameworkSemantic proximity Read

Towards a Holistic Framework for Multimodal Large Language Models in Three-dimensional Brain CT Report GenerationSemantic proximity Read