Article

Multimodal modeling of human emotions using sound, image and text fusion

2023-02-20

Abstract excerpt

Multimodal emotion recognition and analysis is considered a developing research field. Improving the multimodal fusion mechanism plays a key role in the more detailed recognition of the recognized emotion. The present study aimed to optimize the performance of the emotion recognition system and presented a model for multimodal emotion recognition from audio, text, and video data. First, the data were fused as a co...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: d3d50903-22cc-5a40-953f-e380fe5104ff
DOI: 10.21203/rs.3.rs-2579610/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Multimodal modeling of human emotions using sound, image and text fusionDOI 10.21203/rs.3.rs-2579610/v1Read

Modelling Human-Like Emotion Perception Using Multimodal Deep LearningSemantic proximity Read

Bangla Speech Emotion Recognition Using Deep Learning-Based Ensemble Learning and Feature FusionSemantic proximity Read

A Comprehensive Review in Unimodal and Multimodal Emotion RecognitionSemantic proximity Read

A Multimodal Pain Sentiment Analysis System Using Ensembled Deep Learning Approaches for IoT-Enabled Healthcare FrameworkSemantic proximity Read

Speech-based Sentiment Recognition System using PDCNN and LSTM AlgorithmsSemantic proximity Read

A Hybrid Deep Learning Framework for efficient emotion detection on the facial image datasetSemantic proximity Read

HSERNet: Hybrid Speech Emotion Recognition using Conformer-Convolutional Neural NetworksSemantic proximity Read

Development of an Interactive Digital Human with Context-Sensitive Facial ExpressionsSemantic proximity Read

An experimental study in Real-time Facial Emotion Recognition on 3RL datasetSemantic proximity Read

Two Stepped Majority Voting for Efficient EEG based Emotion ClassificationSemantic proximity Read

Multimodal Fusion of EEG and Physiological Signals for Robust Emotion Recognition via Machine LearningSemantic proximity Read

A Deep Learning Framework for Emotion Recognitionin Music Using Multimodal Data FusionSemantic proximity Read