Article

Speech-driven Facial Animations Improve Speech-in-Noise Comprehension of Humans

2021-12-19

Abstract excerpt

Understanding speech becomes a demanding task when the environment is noisy. Comprehension of speech in noise can be substantially improved by looking at the speaker’s face, and this audiovisual benefit is even more pronounced in people with hearing impairment. Recent advances in AI have allowed to synthesize photorealistic talking faces from a speech recording and a still image of a person’s face in an end-to-end...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 04428caf-ef8d-5b94-b1bc-6bfbd4538cbb
DOI: 10.1101/2021.12.18.471222

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Speech-driven Facial Animations Improve Speech-in-Noise Comprehension of HumansDOI 10.1101/2021.12.18.471222Read

The Effect on Speech-in-Noise Perception of Real Faces and Synthetic Faces Generated with either Deep Neural Networks or the Facial Action Coding SystemSemantic proximity Read

RAE-NeRF: Residual-Based Audio-Video Encoder with Denoising in Talking Head SynchronizationSemantic proximity Read

Advancements in Talking Head Generation: A Comprehensive Review of Techniques, Metrics, and ChallengesSemantic proximity Read

Neural Tracking of Audiovisual Effects in Noise Using Deep Neural Network-Generated Virtual HumansSemantic proximity Read

3D head-talk: speech synthesis 3D head movement face animationSemantic proximity Read

IterVocoder: Fast High-Fidelity Speech Synthesis via GAN-Guided Iterative RefinementSemantic proximity Read

Enhancing Human Detection of Real and AI-Generated Hyperrealistic FacesSemantic proximity Read

Enhancing Human Detection of Real and AI-Generated Hyperrealistic FacesSemantic proximity Read

Generating non-verbal responses in virtual agent with use of LSTM networkSemantic proximity Read

Speech Emotion Recognition using Data Augmentation Method by Cycle-Generative Adversarial NetworksSemantic proximity Read

Extracting Dynamic Facial Expressions from Naturalistic VideosSemantic proximity Read

Talking avatars can differentially modulate cortical speech tracking in the high and in the low delta bandSemantic proximity Read