Article

Remember, Retrieve and Generate: Understanding Infinite Visual Concepts as Your Personalized Assistant

2024-11-28

Abstract excerpt

The development of large language models (LLMs) has significantly enhanced the capabilities of multimodal LLMs (MLLMs) as general assistants. However, lack of user-specific knowledge still restricts their application in human’s daily life. In this paper, we introduce the Retrieval Augmented Personalization (RAP) framework for MLLMs’ personalization. Starting from a general MLLM, we turn it into a personalized assi...

Topics

Open a Topic to create a Post that cites this publication.

Uncategorized literature

Identifiers and source

Literature Corpus work: 7b60dc21-728d-52e8-a1e9-b6766f02240f
DOI: 10.32388/95w7kc

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Remember, Retrieve and Generate: Understanding Infinite Visual Concepts as Your Personalized AssistantDOI 10.32388/95w7kcRead

Context-Aware Feature Integration for Enhanced Fine-Grained Understanding in Vision-Language ModelsSemantic proximity Read

A Review of Multimodal Vision–Language Models: Foundations, Applications, and Future DirectionsSemantic proximity Read

Retrieval-Free Suggestion Question Generation via Large Language ModelsSemantic proximity Read

A Review of Multimodal Vision-Language Models: Foundations, Applications, and Future DirectionsSemantic proximity Read

A Survey on Post-Training of Multimodal Large Language ModelsSemantic proximity Read

Tarsier2: Advancing Large Vision-Language Models from Detailed Video Descriptions to Comprehensive Video UnderstandingSemantic proximity Read

RobustVLM: Enhancing Large Vision-Language Models through Adaptive Visual Context Learning, Weak-to-Strong Robust Transfer, and Domain-Adaptive FeedbackSemantic proximity Read

Fine-Grained Multimodal Alignment and Iterative Rectification Learning FrameworkSemantic proximity Read

A Comparative Survey of Large Language Models: Foundation, Instruction-Tuned, and Multimodal VariantsSemantic proximity Read

Vision–Language Foundation Models and Multimodal Large Language Models: A Comprehensive Survey of Architectures, Benchmarks, and Open ChallengesSemantic proximity Read

Vision–Language Foundation Models and Multimodal Large Language Models: A Comprehensive Survey of Architectures, Benchmarks, and Open ChallengesSemantic proximity Read

Egocentric Perception of Walking Environments using an Interactive Vision-Language SystemSemantic proximity Read