Article

VT-BPAN: Vision Transformer-based bilinear pooling and attention network fusion of RGB and skeleton features for human action recognition

2023-03-06

Abstract excerpt

Recent generation Microsoft Kinect Camera captures a series of multimodal signals that provide RGB video, depth sequences, and skeleton information, thus it becomes an option to achieve enhanced human action recognition performance by fusing different data modalities. However, most existing fusion methods simply fuse different features, which ignores the underlying semantics between different models, leading to a...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 066a37fc-abb2-53fc-8748-523be8faba66
DOI: 10.21203/rs.3.rs-2627627/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

VT-BPAN: Vision Transformer-based bilinear pooling and attention network fusion of RGB and skeleton features for human action recognitionDOI 10.21203/rs.3.rs-2627627/v1Read

Video Human Action Recognition by the Fusion of Significant Motion and Coarse-fine Temporal Granularity FeaturesSemantic proximity Read

Human Behavior Recognition Based on Graph Neural Network and Cross-modal Collaborative Attention MechanismSemantic proximity Read

TransMODAL: A Dual-Stream Transformer with Adaptive Co-Attention for Efficient Human Action RecognitionSemantic proximity Read

HAR-ViT:A human activity recognition method based on ViTSemantic proximity Read

A Multi-Attention Fusion Deep Network for Human Activity Recognition in Motor RehabilitationSemantic proximity Read

A Two-Stream Deep Learning Approach for Enhanced Two-Person Human Interaction Recognition in VideosSemantic proximity Read

Real-Time Sports Action Recognition Using a CNN–Transformer Hybrid Deep Learning FrameworkSemantic proximity Read

A Comprehensive Literature Review on the Use of Restricted Boltzmann Machines and Deep Belief Networks for Human Action RecognitionSemantic proximity Read

Human Activity Recognition in the Deep Learning Era: Different Modalities, Recent Advances in Applications, and Emerging TechniquesSemantic proximity Read

Cross-Domain Semantic-Enhanced Adaptive Graph Fusion Network for Robust Skeleton Action RecognitionSemantic proximity Read

A multi-scale feature extraction fusion model for human activity recognitionSemantic proximity Read