Article

RAE-NeRF: Residual-Based Audio-Video Encoder with Denoising in Talking Head Synchronization

2025-09-26

Abstract excerpt

In recent years, speech-driven facial synthesis has attracted significant attention due to its wide applications in virtual humans, remote conferencing, and digital human generation. However, existing methods still face limitations in terms of realism, synchronization, and robustness, primarily due to noise interference in speech signals and insufficient precision in audio-visual feature fusion. To address these c...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 5cf39b87-f231-5f78-95d2-7fadea7ad6a4
DOI: 10.20944/preprints202509.2231.v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

RAE-NeRF: Residual-Based Audio-Video Encoder with Denoising in Talking Head SynchronizationDOI 10.20944/preprints202509.2231.v1Read

Advancements in Talking Head Generation: A Comprehensive Review of Techniques, Metrics, and ChallengesSemantic proximity Read

3D head-talk: speech synthesis 3D head movement face animationSemantic proximity Read

3D-GS Talker: 3D Gaussian Based Audio-Driven Real-Time Talking Head GenerationSemantic proximity Read

Speech-driven Facial Animations Improve Speech-in-Noise Comprehension of HumansSemantic proximity Read

Development of an Interactive Digital Human with Context-Sensitive Facial ExpressionsSemantic proximity Read

Fusing Text-Speech Multimodal Cues with 2D Motion Priors: Boosting 3D Human Motion Generation for VR and AnimationSemantic proximity Read

GrambaTalk: Generating 3D Talking Head with Spatial Graph and Temporal MambaSemantic proximity Read

Identification of the sim-to-real gap in the speech directivity classification task using deep learning techniquesSemantic proximity Read

Identity-Preserving Text-to-Video Generation by Frequency DecompositionSemantic proximity Read

IterVocoder: Fast High-Fidelity Speech Synthesis via GAN-Guided Iterative RefinementSemantic proximity Read

The Effect on Speech-in-Noise Perception of Real Faces and Synthetic Faces Generated with either Deep Neural Networks or the Facial Action Coding SystemSemantic proximity Read

Towards Human-Centered and Efficient Video Synthesis: A Survey of Multimodal Diffusion ModelsSemantic proximity Read