Article

Beyond robotic speech: mutual benefits to cognitive psychology and artificial intelligence from the study of multimodal communication

2020-02-04

Abstract excerpt

<p>Language has predominately been studied as a unimodal phenomenon - as speech or text without much consideration of its physical and social context – this is true both in cognitive psychology/psycholinguistics as well as in artificial intelligence. However, in everyday life, language is most often used in face-to-face communication and in addition to structured speech it comprises a dynamic system of multiplex c...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 26fdf5c7-9b1f-571e-83da-d089088768ca
DOI: 10.31234/osf.io/h5dxy

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Beyond robotic speech: mutual benefits to cognitive psychology and artificial intelligence from the study of multimodal communicationDOI 10.31234/osf.io/h5dxyRead

The Embodied Crossmodal Self Forms Language and Interaction: A Computational Cognitive ReviewSemantic proximity Read

Sensory context as a universal principle of language in humans and LLMsSemantic proximity Read

Operationalizing intentionality in primate communication: Social and ecological considerationsSemantic proximity Read

Sensory context improves language prediction in humans and LLMsSemantic proximity Read

A Theoretical Framework for Human and Nonhuman Vocal InteractionSemantic proximity Read

Comparative perspectives on communication in human and nonhuman primates: Grounding meaning in broadly conserved processes of voice production, perception, affect and cognitionSemantic proximity Read

Multi-Interaction: A New Open-access Approach for Studying and Comparing Multimodal Interactions Across PrimatesSemantic proximity Read

Multi-Interaction: A New Open-access Approachfor Studying and Comparing Multimodal Interactions Across PrimatesSemantic proximity Read

Multimodal Vision Language Models in Interactive and Physical EnvironmentsSemantic proximity Read

Expression Unleashed: The evolutionary & cognitive foundations of human communicationSemantic proximity Read

The role of pragmatic mechanisms in referential communication and categorization: An emergent communication modelSemantic proximity Read