Article

Egocentric Perception of Walking Environments using an Interactive Vision-Language System

2024-12-09

Abstract excerpt

Large language models can provide a more detailed contextual understanding of a scene beyond what computer vision alone can provide, which have implications for robotics and embodied intelligence. In this study, we developed a novel multimodal vision-language system for egocentric visual perception, with an initial focus on real-world walking environments. We trained a number of state-of-the-art transformer-based...

Topics

Open a Topic to create a Post that cites this publication.

Uncategorized literature

Identifiers and source

Literature Corpus work: 3ba47edd-03a9-5e09-894c-4757bfe8cf96
DOI: 10.1101/2024.12.05.627038

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Egocentric Perception of Walking Environments using an Interactive Vision-Language SystemDOI 10.1101/2024.12.05.627038Read

Multimodal Vision Language Models in Interactive and Physical EnvironmentsSemantic proximity Read

A Review of Multimodal Vision–Language Models: Foundations, Applications, and Future DirectionsSemantic proximity Read

A Review of Multimodal Vision-Language Models: Foundations, Applications, and Future DirectionsSemantic proximity Read

Tarsier2: Advancing Large Vision-Language Models from Detailed Video Descriptions to Comprehensive Video UnderstandingSemantic proximity Read

Multi Sentence Description of Complex Manipulation Action VideosSemantic proximity Read

The Storyteller: Computer Vision Driven Context and Content Generation SystemSemantic proximity Read

Unified Generative Vision-Language UnderstandingSemantic proximity Read

Large-Scale Model-Enhanced Vision-Language Navigation: Recent Advances, Practical Applications, and Future ChallengesSemantic proximity Read

FineRegion-LM: Enhancing Large Vision-Language Models for Fine-Grained Region-Level UnderstandingSemantic proximity Read

Generative AI for Text-to-Video Generation: Recent Advances and Future DirectionsSemantic proximity Read

Remember, Retrieve and Generate: Understanding Infinite Visual Concepts as Your Personalized AssistantSemantic proximity Read

PlanAgent: Embodied Visual-Language Model for Grounded Task planning with Environment MapSemantic proximity Read