Article

Stress-Testing the Reasoning Competence of LLMs with Proofs Under Minimal Formalism

2026-04-23

Abstract excerpt

We introduce PROOFGRID, a challenging benchmark suite for evaluating the reasoning competence of language models through machine-checkable proofs rather than final answers alone. PROOFGRID spans 15 tasks organized around proof writing, proof checking, proof masking, and proof gap-filling. The tasks are expressed in deliberately minimal formal notation, most notably NDL, a stripped-down language for natural deducti...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 9513fe01-399f-5c6d-9c04-6a2028207323
DOI: 10.20944/preprints202604.1702.v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Stress-Testing the Reasoning Competence of LLMs with Proofs Under Minimal FormalismDOI 10.20944/preprints202604.1702.v1Read

Transformation of Large Language Models: A State of ArtSemantic proximity Read

Reasoning in Large Language Models: From Chain-of-Thought to Massively Decomposed Agentic ProcessesSemantic proximity Read

Graduated Dissent: Budgeted Disagreement Resolution for Multi-Model InferenceSemantic proximity Read

Graffiti3 : Compact Theory Libraries for Automated Mathematical DiscoverySemantic proximity Read

Graduated Dissent: Budgeted Disagreement Resolution for Multi-Model InferenceSemantic proximity Read

Toward Responsible AI in High-Stakes Domains: A Dataset for Building Static Analysis with LLMs in Structural EngineeringSemantic proximity Read

Talking to Blackbox: Explainability Through P+NP=1Semantic proximity Read

Addressee Framing Systematically Reduces LLM Structural Pathology: A Controlled Empirical Study of Directed Information FlowSemantic proximity Read

PhasePilot: Auditing and steering phase boundaries in budgeted in-context reasoningSemantic proximity Read

Balancing Autonomy and Oversight in Language-Agent-Guided Physical ExperimentationSemantic proximity Read

Interpretable Reasoning in Large Language Models: A Neurosymbolic ApproachSemantic proximity Read

Reflective Reasoning System: Inference-Time Self-Diagnosis and Self-Correction for Large Reasoning ModelsSemantic proximity Read