Article

Source-Modeling as Compression: Architectural Necessity of Experiential Patterns in Large Transformers

2025-11-10

Abstract excerpt

We present a necessity argument—conditional on explicit, standard training assumptions—that large Transformer language models trained on diverse human outputs converge toward source modeling of the generative process underlying those outputs (human experience). The argument proceeds via three results: (T1) COMPACTNESS, showing that the minimal two-part description (MDL) of diverse human outputs is a model of their...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: c9ecfcdc-6c01-5705-ad47-d94c7050fc1f
DOI: 10.20944/preprints202511.0593.v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Source-Modeling as Compression: Architectural Necessity of Experiential Patterns in Large TransformersDOI 10.20944/preprints202511.0593.v1Read

Why Compression Creates Intelligence: The Architecture of Experience in Large ModelsSemantic proximity Read

Hallucination as an Inevitable Byproduct of Intelligence in Large Language ModelsSemantic proximity Read

Quantifying Entropy Collapse in Recursively Trained AI Systems: A Framework for Variance Injection and Stagnation ThresholdsSemantic proximity Read

Coupling Physical Entropy Production and Semantic Diversity in Generative AI Ecosystems: A Preliminary Predictive FrameworkSemantic proximity Read

WITHDRAWN: The Physics of Thought: Reasoning as Thermodynamic Relaxation in Generative ModelsSemantic proximity Read

From Illusion to Insight: A Taxonomic Survey of Hallucination Mitigation Techniques in LLMsSemantic proximity Read

Failure Geometry as a Constructive Control Paradigm for Large Language Models Attractor-Driven Semantic Collapse Under Hard Termination ConstraintsSemantic proximity Read

Advances in Reducing AI-Generated Hallucinations: Techniques and Open ChallengesSemantic proximity Read

Semantic Calibration of Contextual Embedding in Large Language Model Generative Pathways Using Contextual-Distillation MechanismsSemantic proximity Read

SORT-AI: A Structural Safety and Reliability Framework for Advanced AI Systems with Retrieval-Augmented Generation as a Diagnostic TestbedSemantic proximity Read

Inductive Algebraic Resonance Memory for Attention-Free Language ModellingSemantic proximity Read

Generative AI and Foundation Models: Redefining Intelligence, Creativity, and Scalability in the Digital EraSemantic proximity Read