Article

Evaluating the Agreement between Human Preferences, GPT-4V and Gemini Pro Vision Assessments: Can AI Recognise Which Restaurants People Might Like?

2024-04-19

Abstract excerpt

The study aims to introduce a methodology for assessing agreement between AI and human ratings, specifically focusing on visual large language models (LLMs). It presents empirical findings on the alignment between ratings generated by GPT-4 Vision (GPT-4V) and Gemini Pro Vision with human subjective evaluations of environmental visuals. Using photographs of restaurant interior design and food, the study estimates...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 9cfed049-ccfa-5701-84b2-d12e515ea2ec
DOI: 10.21203/rs.3.rs-4257623/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Evaluating the Agreement between Human Preferences, GPT-4V and Gemini Pro Vision Assessments: Can AI Recognise Which Restaurants People Might Like?DOI 10.21203/rs.3.rs-4257623/v1Read

Comparing Perceptual Judgments in Large Multimodal Models and HumansSemantic proximity Read

LLMs Judging Architecture: Generative AI Mirrors Public PollsSemantic proximity Read

Evaluating AI Models for Food and Alcohol Ad Classification Against Human RatersSemantic proximity Read

Image to sentiment pipelines for sustainable cities: a comparison of human and AI responses in urban environmental image analysesSemantic proximity Read

Beyond References: Human-Aligned Caption Reliability AssessmentSemantic proximity Read

A Review of Multimodal Vision–Language Models: Foundations, Applications, and Future DirectionsSemantic proximity Read

A Review of Multimodal Vision-Language Models: Foundations, Applications, and Future DirectionsSemantic proximity Read

Multimodal large language models converge on the human-like geometry of abstract emotionSemantic proximity Read

Predicting Individual Food Valuation via Vision-Language Embedding ModelSemantic proximity Read

Human, AI, and Color Tool: A Comparative Study on Emotion-Color AssociationsSemantic proximity Read

Color-emotion associations in text-to-image modelsSemantic proximity Read

Towards Cognition-Aligned Visual Language Models via Zero-Shot Instance RetrievalSemantic proximity Read