Article

Mind Captioning: Evolving descriptive text of mental content from human brain activity

2024-04-26

Abstract excerpt

A central challenge in neuroscience is decoding brain activity to uncover mental content comprising multiple components and their interactions. Despite progress in decoding language-related information from human brain activity, generating comprehensive descriptions of complex mental content associated with structured visual semantics remains challenging. We present a method that generates descriptive text mirrori...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 7ab46b32-8b5f-5fa1-a6d2-459d798e72aa
DOI: 10.1101/2024.04.23.590673

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Mind Captioning: Evolving descriptive text of mental content from human brain activityDOI 10.1101/2024.04.23.590673Read

Comprehensive Neural Representations of Naturalistic Stimuli through Multimodal Deep LearningSemantic proximity Read

Multimodal large language models converge on the human-like geometry of abstract emotionSemantic proximity Read

NiCLIP: Neuroimaging contrastive language-image pretraining model for predicting text from brain activation imagesSemantic proximity Read

Efficient fMRI and Textual Alignment for ImageReconstruction from Human Brain ActivitySemantic proximity Read

Simulation of Natural Language from Brain Activity Using Wearable EEG and Deep LearningSemantic proximity Read

Reconstructing the brain’s language network from non-invasive EEG enables interpretable speech decodingSemantic proximity Read

High-level visual cortex representations are organized along visual rather than abstract principlesSemantic proximity Read

Driving and suppressing the human language network using large language modelsSemantic proximity Read

Language processing in brains and deep neural networks: computational convergence and its limitsSemantic proximity Read

Dimensionality and ramping: Signatures of sentence integration in the dynamics of brains and deep language modelsSemantic proximity Read

Identifying Naturalistic Movies from Human Brain Activity with High-Density Diffuse Optical TomographySemantic proximity Read

RNIC-A Retrospect Network for image captioningSemantic proximity Read