Article

3D-GS Talker: 3D Gaussian Based Audio-Driven Real-Time Talking Head Generation

2024-07-05

Abstract excerpt

<title>Abstract</title> <p>In recent years, significant advancements have been made in the field of 3D talking head generation, yet achieving real-time rendering remains a persistent challenge critical for interactive applications. To address this, we present the 3D-GS Talker framework, a groundbreaking solution that leverages 3D Gaussian Splatting (3D-GS) to revolutionize real-time talking head synthesis. Unlike...

Topics

Open a Topic to create a Post that cites this publication.

Uncategorized literature

Identifiers and source

Literature Corpus work: e2678131-38a4-5ab2-abbc-820e21d28291
DOI: 10.21203/rs.3.rs-4558717/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

3D-GS Talker: 3D Gaussian Based Audio-Driven Real-Time Talking Head GenerationDOI 10.21203/rs.3.rs-4558717/v1Read

Advancements in Talking Head Generation: A Comprehensive Review of Techniques, Metrics, and ChallengesSemantic proximity Read

GrambaTalk: Generating 3D Talking Head with Spatial Graph and Temporal MambaSemantic proximity Read

3D head-talk: speech synthesis 3D head movement face animationSemantic proximity Read

RAE-NeRF: Residual-Based Audio-Video Encoder with Denoising in Talking Head SynchronizationSemantic proximity Read

Towards Human-Centered and Efficient Video Synthesis: A Survey of Multimodal Diffusion ModelsSemantic proximity Read

GestureFM : Compact Latent Flow Matching for Low-Latency Co-Speech Body-Motion GenerationSemantic proximity Read

Fusing Text-Speech Multimodal Cues with 2D Motion Priors: Boosting 3D Human Motion Generation for VR and AnimationSemantic proximity Read

HoloGest: Decoupled Diffusion and Motion Priors for Generating Holisticly Expressive Co-speech GesturesSemantic proximity Read

Speech-driven Facial Animations Improve Speech-in-Noise Comprehension of HumansSemantic proximity Read

Improving Text-Speech Driven 3D Human Motion Synthesis via 2D Data Augmentation and CLaM-Based Standardized EvaluationSemantic proximity Read

Identity-Preserving Text-to-Video Generation by Frequency DecompositionSemantic proximity Read

Development of an Interactive Digital Human with Context-Sensitive Facial ExpressionsSemantic proximity Read