Article

Neural Tracking of Audiovisual Effects in Noise Using Deep Neural Network-Generated Virtual Humans

2025-06-05

Abstract excerpt

This study investigates the effectiveness of Deep Neural Network (DNN)-generated virtual humans in enhancing audiovisual speech perception in noisy environments, with a focus on using neural measures to quantify these effects. Lip movements are essential for speech comprehension, especially when auditory cues are degraded by noise. Traditional recording methods produce high-quality audiovisual materials but are re...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: e656c7d6-1dcc-5021-b8a6-ea42d7879981
DOI: 10.1101/2025.06.02.656280

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Neural Tracking of Audiovisual Effects in Noise Using Deep Neural Network-Generated Virtual HumansDOI 10.1101/2025.06.02.656280Read

Talking avatars can differentially modulate cortical speech tracking in the high and in the low delta bandSemantic proximity Read

The Effect on Speech-in-Noise Perception of Real Faces and Synthetic Faces Generated with either Deep Neural Networks or the Facial Action Coding SystemSemantic proximity Read

Speech-driven Facial Animations Improve Speech-in-Noise Comprehension of HumansSemantic proximity Read

Identification of the sim-to-real gap in the speech directivity classification task using deep learning techniquesSemantic proximity Read

Perception of concatenative vs. neural text-to-speech (TTS): Differences in intelligibility in noise and language attitudesSemantic proximity Read

A Neural Speech Decoding Framework Leveraging Deep Learning and Speech SynthesisSemantic proximity Read

The timing of an avatar’s beat gestures biases lexical stress perception in vocoded speechSemantic proximity Read

The timing of an avatar’s beat gestures biases lexical stress perception in vocoded speechSemantic proximity Read

Advancements in Talking Head Generation: A Comprehensive Review of Techniques, Metrics, and ChallengesSemantic proximity Read

A Deep Neural Network Model of Audiovisual Speech Recognition Reports the McGurk EffectSemantic proximity Read

Speech and non-speech measures of audiovisual integration are not correlatedSemantic proximity Read

Validation of Scrambling Methods for Vocal Affect BurstsSemantic proximity Read