Article

Exploration of Stability Judgments: From Multimodal LLMs to Human Insights

2025-09-22

Abstract excerpt

This study extends our previous investigation into whether multimodal large language models (MLLMs) can reason about physical reasoning, using a game environment as the testbed. Stability served as a foundational scenario to probe model understanding of physical reasoning. We evaluated twelve models, combining those from the earlier study with six additional Open-weight models, and compared them with human partici...

Topics

Open a Topic to create a Post that cites this publication.

Genomics and Rare Diseases

Identifiers and source

Literature Corpus work: e9698d18-235c-5606-be20-7e7155e53c23
DOI: 10.20944/preprints202509.1708.v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Exploration of Stability Judgments: From Multimodal LLMs to Human InsightsDOI 10.20944/preprints202509.1708.v1Read

Reasoning in Large Language Models: From Chain-of-Thought to Massively Decomposed Agentic ProcessesSemantic proximity Read

Nonlinear Transformation of Probabilities by Large Language ModelsSemantic proximity Read

Studying and improving reasoning in humans and machinesSemantic proximity Read

Worth the Weight: Modern LLMs Demonstrate Accurate Metacognitive Knowledge of Decision Weights in Multi-Attribute ChoiceSemantic proximity Read

What have we learned about human reasoning from large reasoning models? Response to de Varda et al.Semantic proximity Read

Understanding Logical Reasoning Ability of Large Language ModelsSemantic proximity Read

Artificial Intelligence and Metacognitive Knowledge: LLMs Can Report Decision Weights as Faithfully as Humans in Multi-Attribute ChoiceSemantic proximity Read

Phy-Q: A Testbed for Physical ReasoningSemantic proximity Read

Probabilistic Chain-of-Evidence: Enhancing Factual Accuracy and Uncertainty Reasoning in Large Language Models via Prompt EngineeringSemantic proximity Read

GenReasoner: Generative Visual Agent PlanningSemantic proximity Read

Evaluating Logical Reasoning Ability of Large Language ModelsSemantic proximity Read

Interpretable Reasoning in Large Language Models: A Neurosymbolic ApproachSemantic proximity Read