Article

The Effect on Speech-in-Noise Perception of Real Faces and Synthetic Faces Generated with either Deep Neural Networks or the Facial Action Coding System

2024-02-06

Abstract excerpt

The prevalence of synthetic talking faces in both commercial and academic environments is increasing as the technology to generate them grows more powerful and available. While it has long been known that seeing the face of the talker improves human perception of speech-in-noise, recent studies have shown that synthetic talking faces generated by deep neural networks (DNNs) are also able to improve human perceptio...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 4f025b02-57c9-5aba-a4c1-106d81d9b01a
DOI: 10.1101/2024.02.05.578468

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

The Effect on Speech-in-Noise Perception of Real Faces and Synthetic Faces Generated with either Deep Neural Networks or the Facial Action Coding SystemDOI 10.1101/2024.02.05.578468Read

Speech-driven Facial Animations Improve Speech-in-Noise Comprehension of HumansSemantic proximity Read

Neural Tracking of Audiovisual Effects in Noise Using Deep Neural Network-Generated Virtual HumansSemantic proximity Read

Extracting Dynamic Facial Expressions from Naturalistic VideosSemantic proximity Read

Talking avatars can differentially modulate cortical speech tracking in the high and in the low delta bandSemantic proximity Read

Advancements in Talking Head Generation: A Comprehensive Review of Techniques, Metrics, and ChallengesSemantic proximity Read

RAE-NeRF: Residual-Based Audio-Video Encoder with Denoising in Talking Head SynchronizationSemantic proximity Read

Perception of Humanness Is Affected by Speech ContentSemantic proximity Read

Reconstructing Voice Identity from Noninvasive Auditory Cortex RecordingsSemantic proximity Read

Behavioral characterization of dynamic facial expression perception in rhesus monkeys <i>(Macaca mulatta)</i> using naturalistic and synthetic stimuliSemantic proximity Read

Validation of Scrambling Methods for Vocal Affect BurstsSemantic proximity Read

A Neural Speech Decoding Framework Leveraging Deep Learning and Speech SynthesisSemantic proximity Read

Identification of the sim-to-real gap in the speech directivity classification task using deep learning techniquesSemantic proximity Read