Article
HierMem: Context Curation Over Context Scaling — Hierarchical Memory with Invariant Constraint Placement for Long-Horizon LLM Conversations
2026-06-17
Abstract excerpt
<title>Abstract</title> <p>The industry assumes that larger context windows are the solution to long-horizon conversational AI. This assumption is fundamentally flawed. Flooding a Large Language Model (LLM) with raw historical turns actively degrades reasoning through the "lost in the middle" effect, dilutes critical user constraints, and incurs massive compute costs. LLMs do not need to process every past intera...
Topics
Open a Topic to create a Post that cites this publication.
Identifiers and source
- Literature Corpus work
- f51be69b-e1a6-5c5d-a7ac-3a9c7ef5510f
- DOI
- 10.21203/rs.3.rs-10055780/v1
