Article

Assessing large multimodal models for one-shot learning and interpretability in biomedical image classification

2024-01-01

Abstract excerpt

<h4>ABSTRACT</h4> Image classification plays a pivotal role in analyzing biomedical images, serving as a cornerstone for both biological research and clinical diagnostics. We demonstrate that large multimodal models (LMMs), like GPT-4, excel in one-shot learning, generalization, interpretability, and text-driven image classification across diverse biomedical tasks. These tasks include the classification of tissue...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: d6d68fe6-c337-5acc-94ca-e6ad56349070
DOI: 10.1101/2023.12.31.573796

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Assessing large multimodal models for one-shot learning and interpretability in biomedical image classificationDOI 10.1101/2023.12.31.573796Read

GPT-4V exhibits human-like performance in biomedical image classificationSemantic proximity Read

Domain specific models outperform large vision language models on cytomorphology tasksSemantic proximity Read

Integrating images and genomics for multi-modal cancer survival analysis via mixture of expertsSemantic proximity Read

CT Multi-Task Learning with a Large Image-Text (LIT) ModelSemantic proximity Read

Comparative Analysis of GPT-4Vision, GPT-4 and Open Source LLMs in Clinical Diagnostic Accuracy: A Benchmark Against Human ExpertiseSemantic proximity Read

TeamPath: Building MultiModal Pathology Experts with Reasoning AI CopilotsSemantic proximity Read

A Versatile Foundation Model for AI-enabled Mammogram InterpretationSemantic proximity Read

ALPaCA: Adapting Llama for Pathology Context Analysis to enable slide-level question answeringSemantic proximity Read

Integrating Multimodal Data with Large Foundation Models in HealthcareSemantic proximity Read

Large-vocabulary forensic pathological analyses via prototypical cross-modal contrastive learningSemantic proximity Read

Adaptive Contextual-Relational Network for Fine-Grained Gastrointestinal Disease ClassificationSemantic proximity Read

A Multimodal Vision-text AI Copilot for Brain Disease Diagnosis and Medical ImagingSemantic proximity Read