Article

Visual Semantics in MT Evaluation: Do Image Descriptions Help with Assessment of Multimodal MT Quality?

2026-06-22

Abstract excerpt

Multimodal machine translation aims to integrate visual context, such as images, with textual data to improve the translation of ambiguous source text. However, the evaluation of these systems still largely relies on traditional automatic metrics, which do not account for additional modalities during evaluation. The lack of dedicated evaluation methods often results in inconsistent findings and creates uncertainty...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: e2dc1f4c-128c-5865-9b94-d921da2ad75d
DOI: 10.20944/preprints202606.1564.v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Visual Semantics in MT Evaluation: Do Image Descriptions Help with Assessment of Multimodal MT Quality?DOI 10.20944/preprints202606.1564.v1Read

Adaptive Semantic Fusion for Contextual Image CaptioningSemantic proximity Read

Fine-Grained Multimodal Alignment and Iterative Rectification Learning FrameworkSemantic proximity Read

A Review of Multimodal Vision–Language Models: Foundations, Applications, and Future DirectionsSemantic proximity Read

Beyond References: Human-Aligned Caption Reliability AssessmentSemantic proximity Read

A Review of Multimodal Vision-Language Models: Foundations, Applications, and Future DirectionsSemantic proximity Read

Advancing Multimodal Visual Analytics for Disaster Management with LLM-Enhanced CLIPSemantic proximity Read

RobustVLM: Enhancing Large Vision-Language Models through Adaptive Visual Context Learning, Weak-to-Strong Robust Transfer, and Domain-Adaptive FeedbackSemantic proximity Read

Vision–Language Foundation Models and Multimodal Large Language Models: A Comprehensive Survey of Architectures, Benchmarks, and Open ChallengesSemantic proximity Read

Vision–Language Foundation Models and Multimodal Large Language Models: A Comprehensive Survey of Architectures, Benchmarks, and Open ChallengesSemantic proximity Read

RefCap: Image Captioning with Referent Objects AttributesSemantic proximity Read

Enhancing Caption Fidelity via Explanation-Guided Captioning with Vision-Language Fine-TuningSemantic proximity Read

Image Caption Generation For Blind Users Of Social Media WebsitesSemantic proximity Read