Article

Comprehensive Neural Representations of Naturalistic Stimuli through Multimodal Deep Learning

2025-04-19

Abstract excerpt

A central challenge in cognitive neuroscience is understanding how the brain represents and predicts complex, multimodal experiences in naturalistic settings. Traditional neural encoding models, often based on unimodal or static features, fall short in capturing the rich, dynamic structure of real-world cognition. Here, we address this challenge by introducing a video-text alignment encoding framework that predict...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 42d7702e-6979-5355-95d2-e1c85bb802ab
DOI: 10.1101/2025.04.15.646250

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Comprehensive Neural Representations of Naturalistic Stimuli through Multimodal Deep LearningDOI 10.1101/2025.04.15.646250Read

Cortical response to naturalistic stimuli is largely predictable with deep neural networksSemantic proximity Read

Encoding neural representations of time-continuous stimulus-response transformations in the human brain with advanced deep neural networksSemantic proximity Read

Mind Captioning: Evolving descriptive text of mental content from human brain activitySemantic proximity Read

A unifying computational account of temporal context effects in language across the human cortexSemantic proximity Read

Shared Hierarchical Representations Explain Temporal Correspondence Between Brain Activity and Deep Neural NetworksSemantic proximity Read

Multimodal large language models converge on the human-like geometry of abstract emotionSemantic proximity Read

A large and rich EEG dataset for modeling human visual object recognitionSemantic proximity Read

Deep neural networks and visuo-semantic models explain complementary components of human ventral-stream representational dynamicsSemantic proximity Read

Language processing in brains and deep neural networks: computational convergence and its limitsSemantic proximity Read

High-level visual cortex representations are organized along visual rather than abstract principlesSemantic proximity Read

Time without clocks: Human time perception based on perceptual classificationSemantic proximity Read

Discovering event structure in continuous narrative perception and memorySemantic proximity Read