Article

Expanding Multilingual Co-Speech Interaction: The Impact of Enhanced Gesture Units in Text-to-Gesture Synthesis for Digital Humans

2023-09-21

Abstract excerpt

In this study, we explore the effects of co-speech gesture generation on user experience in 3D digital human interaction by testing two key hypotheses. The first hypothesis posits that increasing the number of gestures enhances the user experience across criteria such as naturalness, human-likeness, temporal consistency, semantic consistency, and social presence. The second hypothesis suggests that language transl...

Topics

Open a Topic to create a Post that cites this publication.

Uncategorized literature

Identifiers and source

Literature Corpus work: d517be93-31af-5275-b9c4-0f9e5271fce8
DOI: 10.21203/rs.3.rs-3350470/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Expanding Multilingual Co-Speech Interaction: The Impact of Enhanced Gesture Units in Text-to-Gesture Synthesis for Digital HumansDOI 10.21203/rs.3.rs-3350470/v1Read

A Comparative Study of Large Language Models for Gesture Selection in Virtual AgentsSemantic proximity Read

A richly annotated dataset of in-context co-speech hand gestures across diverse speaker professionsSemantic proximity Read

HoloGest: Decoupled Diffusion and Motion Priors for Generating Holisticly Expressive Co-speech GesturesSemantic proximity Read

Fusing Text-Speech Multimodal Cues with 2D Motion Priors: Boosting 3D Human Motion Generation for VR and AnimationSemantic proximity Read

Development of an Interactive Digital Human with Context-Sensitive Facial ExpressionsSemantic proximity Read

Improving Text-Speech Driven 3D Human Motion Synthesis via 2D Data Augmentation and CLaM-Based Standardized EvaluationSemantic proximity Read

Agentic Sign Language: Balanced Evaluation and Adaptive Monitoring for Inclusive Multimodal CommunicationSemantic proximity Read

Collaborative Assembly with Dynamic Environment for Human-Robot Interaction via Multi-Modal Large Language ModelSemantic proximity Read

GestureFM : Compact Latent Flow Matching for Low-Latency Co-Speech Body-Motion GenerationSemantic proximity Read

Agentic Sign Language: Balanced Evaluation and Adaptive Monitoring for Inclusive Multimodal CommunicationSemantic proximity Read

A New Paradigm for Human Motion Generation Based on Cross-Modal Nested AlignmentSemantic proximity Read