Back to search

Article

Stateful Continuous Thinking: Emergent Self-Referential Dynamics in Stateful Language Models

2026-04-23

Abstract excerpt

<title>Abstract</title> <p>When we talk to a large language model, it answers and then forgets everything. The hidden state that represents its "understanding" is reset after every call. Recent work \citep{huang2025working} confirms this formally: transformer-based LLMs cannot hold information in their latent state across inference steps. We think the problem is not the model's capability, but the architecture---...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work
a81e90f7-b92d-57b2-b7ea-162ee4447e8f
DOI
10.21203/rs.3.rs-9503488/v1
Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest
Interactive article relationship graphSelect a related publication card to move it into the centre and load its closest explainable connections. Solid lines are source-backed structured connections. Dashed lines are semantic discovery signals and are not scientific evidence.
Stateful Continuous Thinking: Emergent Self-Referential Dynamics in Stateful Language ModelsDOI 10.21203/rs.3.rs-9503488/v1
Select a neighboring publication to make it the new centre.