EvoMemState: Evolving Memory State for Personal Agents
Zhishang Xiang, Yunbo Tang, Zhongqiao Liu, Junkai Chen, Zerui Chen, Qingguo Hu, Yuxuan Zhang, William Grant and 2 others
Xiamen University · Nanyang Technological University · University of British Columbia · University of Waterloo · Jilin University
Published November 2, 2026 · on the feed November 6, 2026 · ▲ 35 · arXiv 2611.03743
The abstract
Long-term memory enables large language model (LLM) agents to provide continuous personalized assistance by retaining user information across interactions. Existing systems support this process through fact extraction, organization, updating, and retrieval, but largely maintain memories as independent facts. This fact-centric paradigm may overlook how new facts update, constrain, or conflict with earlier ones, while leaving their applicability, role, and priority for the current request implicit. In this paper, we introduce EvoMemState, a state-centric framework that augments persistent facts with two complementary states: Relational States that capture how facts remain valid and relate to one another as memory evolves, and a Reasoning State that determines how these facts should be applied to the current request. Specifically, EvoMemState consists of three key components: (i) Ontology-Guided Memory State Induction extracts Persistent Facts and constructs Relational States that maintain their validity, scope, and evolving relations. (ii) RL-Based State Evolution internalizes memory-use experience into a policy through reinforcement learning to generate a request-specific Reasoning State. (iii) State-Aware Reasoning then combines the relevant facts with their Relational States and the generated Reasoning State to guide the personal agent. Extensive experiments on long-term dialogue and memory-use benchmarks demonstrate consistent improvements over existing memory systems in retrieval completeness and memory-grounded response accuracy. Our code and implementation details are available at https://github.com/XMUDeepLIT/EvoMemState.git.
The Brief
2:37A short podcast summary of the paper. Written and voiced by AI.
Transcript
EvoMemState. Evolving Memory State for Personal Agents. By Zhishang Xiang and nine others, from Xiamen University, Nanyang Technological University, and three other institutions. Published on the second of November.
A personal agent built on a large language model is only as useful over time as what it remembers. Long-term memory lets it retain user information across interactions and keep its assistance continuous and personalised. Existing memory systems handle this through a pipeline of fact extraction, organisation, updating and retrieval. Yet they largely keep memories as independent facts, each one standing alone. The authors argue that this fact-centric paradigm can miss how a new fact updates an earlier one, constrains it, or conflicts with it. It also leaves implicit whether a fact applies to the request at hand, what role it plays there, and how much priority it deserves.
EvoMemState shifts the unit of memory from facts to states. Persistent facts are kept, but they are augmented with two complementary kinds of state. Relational States capture how facts remain valid and how they relate to one another as memory evolves over time. A Reasoning State, by contrast, belongs to the current request: it determines how those facts should be applied to what the user is asking right now. One kind of state looks across the history, the other looks at the present moment.
Three components carry this out. The first, Ontology-Guided Memory State Induction, extracts Persistent Facts and builds the Relational States that maintain each fact's validity, its scope, and its evolving relations to the rest. The second, RL-Based State Evolution, uses reinforcement learning to internalise experience of how memory gets used into a policy, and that policy generates a Reasoning State specific to each request. The third, State-Aware Reasoning, brings the pieces together. It combines the relevant facts with their Relational States and the freshly generated Reasoning State, and uses that combination to guide the personal agent's answer.
The evaluation runs on long-term dialogue benchmarks and on memory-use benchmarks. Across these, the authors report consistent improvements over existing memory systems on two measures: retrieval completeness, meaning how fully the relevant memories are recovered, and memory-grounded response accuracy, meaning whether the agent's replies are correct given what it should remember. The abstract does not give the individual figures, only that the gains hold consistently.
Underneath the three components sits one reframing. A memory store that holds facts as isolated entries treats remembering as lookup. EvoMemState treats it as bookkeeping on relationships plus a judgment made fresh for each request: which facts still hold, how they bear on one another, and how they should shape this particular answer. The reported gains in completeness and grounded accuracy are the evidence offered that this extra structure pays for itself.
Paper Quest · 7 chapters · about 40 min
Play this paper
Learn it by doing: make the calls the authors made, guess the result before you see it, and defend it in a viva graded on your own words. Chapter 1 is right here.
Chapter 1 🧩 · The problem
Remembering everything is not the same as knowing what matters now.
You build an assistant that remembers its user across months of chats. Each conversation adds facts: a knee injury, a changed diet, a new job.
The road ahead
- 1 · The problem ~6 min An assistant that stores each remembered fact on its own loses how facts change each other, and still misjudges which ones matter now.
- 2 · What came before ~3 min
- 3 · The key idea ~9 min Memory becomes fact plus state: facts carry records of how they relate, and each request gets a learned note on how to use them.
- 4 · Choose your own research ~3 min
- 5 · Build the method ~8 min Extract facts, link them in an ontology, have an RL-trained policy write per-request guidance, then let the frozen agent answer with it.
- 6 · The experiment ~6 min You’ll guess: Against existing memory systems on long-term dialogue and memory-use benchmarks, where did EvoMemState improve?
- 7 · The viva ~5 min Three questions from the examiners, answered in your own words. Win it for the paper’s trophy.
Free, with Google or an email address. Your stars and progress are kept.