Article

Unified Generative Vision-Language Understanding

2024-11-29

Abstract excerpt

This paper introduces an innovative learning framework where linguistic representations are inherently grounded in visual perceptions, circumventing the need for predefined categorical structures. The proposed method, termed Generative Semantic Embedding Model (GSEM), employs a unified generative strategy to construct a shared semantic-visual embedding space. This embedding facilitates robust language grounding ac...

Topics

Open a Topic to create a Post that cites this publication.

Uncategorized literature

Identifiers and source

Literature Corpus work: 5070e8c7-1421-5096-9a38-9d2437b8bb80
DOI: 10.20944/preprints202411.2316.v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Unified Generative Vision-Language UnderstandingDOI 10.20944/preprints202411.2316.v1Read

Vision–Language Foundation Models and Multimodal Large Language Models: A Comprehensive Survey of Architectures, Benchmarks, and Open ChallengesSemantic proximity Read

Vision–Language Foundation Models and Multimodal Large Language Models: A Comprehensive Survey of Architectures, Benchmarks, and Open ChallengesSemantic proximity Read

FineRegion-LM: Enhancing Large Vision-Language Models for Fine-Grained Region-Level UnderstandingSemantic proximity Read

Contextual Synergy through Explicit and Implicit Relations: A Unified Perspective for Image Description GenerationSemantic proximity Read

Egocentric Perception of Walking Environments using an Interactive Vision-Language SystemSemantic proximity Read

Making a scene – using GAN generated scenes to test the role of real-world co-occurence statistics and hierarchical feature spaces in scene understanding.Semantic proximity Read

Abstracted Gaussian Prototypes for One-Shot Concept LearningSemantic proximity Read

Context-Aware Feature Integration for Enhanced Fine-Grained Understanding in Vision-Language ModelsSemantic proximity Read

A Review of Multimodal Vision–Language Models: Foundations, Applications, and Future DirectionsSemantic proximity Read

Leveraging Context for Perceptual Prediction using Word EmbeddingsSemantic proximity Read

Leveraging Context for Perceptual Prediction using Word EmbeddingsSemantic proximity Read

Leveraging Context for Perceptual Prediction using Word EmbeddingsSemantic proximity Read