Article

A Deep Neural Network Model of Audiovisual Speech Recognition Reports the McGurk Effect

2025-08-24

Abstract excerpt

In the McGurk effect, perception of an auditory syllable changes dramatically when it is paired with an incongruent visual syllable, countering our intuition that speech perception is solely an auditory process. The dominant modeling framework for the study of audiovisual speech perception is that of Bayesian causal inference, but current Bayesian models are unable to predict the wide range of percepts evoked by M...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: c17d3c88-2cf5-54c9-a10c-54372e834f00
DOI: 10.1101/2025.08.20.671347

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

A Deep Neural Network Model of Audiovisual Speech Recognition Reports the McGurk EffectDOI 10.1101/2025.08.20.671347Read

Interference of mid-level sound statistics underlie human speech recognition sensitivity in natural noiseSemantic proximity Read

Neural Tracking of Audiovisual Effects in Noise Using Deep Neural Network-Generated Virtual HumansSemantic proximity Read

Speech and non-speech measures of audiovisual integration are not correlatedSemantic proximity Read

Talking avatars can differentially modulate cortical speech tracking in the high and in the low delta bandSemantic proximity Read

Sensory context as a universal principle of language in humans and LLMsSemantic proximity Read

Neural basis of learning to perceive speech through touch using an acoustic-to-vibrotactile speech sensory substitutionSemantic proximity Read

Humans use overconfident estimates of auditory spatial and temporal uncertainty for perceptual inferenceSemantic proximity Read

Inferring the basis of binaural detection with a modified autoencoderSemantic proximity Read

Human brains implicitly and rapidly distinguish AI from human voices before decoding prosodic meaningSemantic proximity Read

Individual differences in Speech-in-Noise perception in adults with healthy hearing: auditory, cognitive, and neural mechanismsSemantic proximity Read

Crossmodal Hierarchical Predictive Coding for Audiovisual Sequences in Human BrainSemantic proximity Read

Sensory context improves language prediction in humans and LLMsSemantic proximity Read