Article

Efficient fMRI and Textual Alignment for ImageReconstruction from Human Brain Activity

2024-09-09

Abstract excerpt

<title>Abstract</title> <p>In neural decoding research, reconstructing natural images from fMRI signalsposes a captivating yet challenging problem. Conventional approaches use basiclinear mapping functions to project fMRI signals into a prior latent space (e.g.,image and text embeddings) and subsequently utilize a pre-trained image gener-ation model to create images conditioned on the embedding. While effective a...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 90f823f0-3e23-5850-a904-6b6a11782db4
DOI: 10.21203/rs.3.rs-4760782/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Efficient fMRI and Textual Alignment for ImageReconstruction from Human Brain ActivityDOI 10.21203/rs.3.rs-4760782/v1Read

Generative learning with multimodal prompts as computational model for brain responsesSemantic proximity Read

NeuroVLM: A generative vision-language framework for human neuroimagingSemantic proximity Read

Mind Captioning: Evolving descriptive text of mental content from human brain activitySemantic proximity Read

End-to-end deep image reconstruction from human brain activitySemantic proximity Read

Synthesizing images to map neural networks to the human brainSemantic proximity Read

Generative Language Reconstruction from Brain RecordingsSemantic proximity Read

Predicting brain activity using TransformersSemantic proximity Read

NiCLIP: Neuroimaging contrastive language-image pretraining model for predicting text from brain activation imagesSemantic proximity Read

GenBrain: A Generative Foundation Model of Multimodal Brain ImagingSemantic proximity Read

Identifying Naturalistic Movies from Human Brain Activity with High-Density Diffuse Optical TomographySemantic proximity Read

Deep image reconstruction from human brain activitySemantic proximity Read

MRI2PET: Realistic PET Image Synthesis from MRI for Automated Inference of Brain Atrophy and Alzheimer’sSemantic proximity Read