Article

Resource-Aware Memory Lifecycle Management for Long-Term RAG Inference with Compact Language Models

2026-06-11

Abstract excerpt

<title>Abstract</title> <p>Long-running RAG services incur a hidden systems cost: retrieval remains active even when the memory it accesses has become stale, cold, or redundant. We present a resource-aware memory lifecycle management framework for long-term RAG inference with compact language models, and evaluate its computational efficiency on a combined 664-problem code generation benchmark under simulated long...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 704bba43-410c-5885-8dc9-713b8b46a177
DOI: 10.21203/rs.3.rs-9843910/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Resource-Aware Memory Lifecycle Management for Long-Term RAG Inference with Compact Language ModelsDOI 10.21203/rs.3.rs-9843910/v1Read

RePCS: Diagnosing Data Memorization in LLM-Powered Retrieval-Augmented GenerationSemantic proximity Read

Learning to Retrieve, Generate, and Compress: A Unified View of Efficient RAGSemantic proximity Read

HyperLLM: The Next Generation of Large Language Models with Multimodal CapabilitiesSemantic proximity Read

CCR4 drives ATLL jail break.Semantic proximity Read

Move Quality Beyond Arena: Pure Distillation for Small Go NetworksSemantic proximity Read

Hybrid Classical--Quantum Learning for Space Based Data Centers: A CUDA-Q Study of Variational and Photonic BackendsSemantic proximity Read

HierMem: Context Curation Over Context Scaling — Hierarchical Memory with Invariant Constraint Placement for Long-Horizon LLM ConversationsSemantic proximity Read

DASH-CAM: Dynamic Approximate SearcH Content Addressable Memory for genome classificationSemantic proximity Read

Execution Grounded Multiagent Systems for Reliable Backend Code Generation with Large Language Models'Semantic proximity Read

Protocol-Dependent Resolution in Finite-Sample Model SelectionSemantic proximity Read

Optimizing Large Language Model Scaling with Micro Batch Pipeline and Inference ParallelismSemantic proximity Read

Investigating Reproducibility Challenges in LLM Bugfixing on the HumanEvalFix BenchmarkSemantic proximity Read