Article
Stateful Continuous Thinking: Emergent Self-Referential Dynamics in Stateful Language Models
2026-04-23
Abstract excerpt
<title>Abstract</title> <p>When we talk to a large language model, it answers and then forgets everything. The hidden state that represents its "understanding" is reset after every call. Recent work \citep{huang2025working} confirms this formally: transformer-based LLMs cannot hold information in their latent state across inference steps. We think the problem is not the model's capability, but the architecture---...
Topics
Open a Topic to create a Post that cites this publication.
Identifiers and source
- Literature Corpus work
- a81e90f7-b92d-57b2-b7ea-162ee4447e8f
- DOI
- 10.21203/rs.3.rs-9503488/v1
