Beyond the Remembered World: Predictive 4D Belief for Persistent Navigation in Evolving Worlds

Mingjian Gao, Zhaocheng Li, Haoyang Huang, Wenqiao Zhang, Yingjie Niu, Hao Zhou, Chao Li, Juncheng Li and 2 others

Zhejiang University · University of California, San Diego · Deeprobotics · Chinese University of Hong Kong

Published September 30, 2026 · on the feed October 1, 2026 · ▲ 5 · arXiv 2609.39166

Robotics & embodiedAgents Code arXiv ↗Hugging Face ↗

The abstract

Persistent spatial memory enables embodied agents to navigate familiar environments across repeated visits. However, targets may move while unobserved, including during navigation, making remembered locations unreliable by the time an agent arrives. Despite advances in memory retrieval and state prediction, accounting for continued hidden world evolution and revising beliefs under limited visibility remain challenging. We study Evolving-World Navigation, where agents infer target locations from intermittent observations, predict their states at inspection time, and revise beliefs using visual evidence. We propose EvolvingNav, which constructs a time-indexed belief from timestamped 3D object histories through a structured persistence-relocation model. The belief distinguishes persistence at the last observed location from relocation to alternative locations and retains probability mass outside the known candidate set. An event-driven filter propagates the current belief as time elapses, forecasts target occupancy at candidate inspection times, and incorporates new RGB-D evidence. Negative observations downweight location hypotheses according to calibrated, visibility-conditioned detection probabilities, while evidence tracking prevents repeated use of the same observations. A frozen, zero-shot vision-language controller uses the updated belief to choose actions and replan. We further introduce EvoWorld-Bench, a benchmark grounded in human activity traces, comprising 54 scenes and 803,680 tasks with controlled changes before and during navigation. In simulation and real-robot experiments, EvolvingNav improves navigation success and search efficiency over the evaluated baselines. Paired experiments show the clearest gains under learnable temporal patterns, while ablations demonstrate the value of preserving uncertainty and incorporating visibility-aware evidence.

The Brief

2:50

A short podcast summary of the paper. Written and voiced by AI.

Transcript

Beyond the Remembered World. Predictive 4D Belief for Persistent Navigation in Evolving Worlds. By Mingjian Gao and nine others, from Zhejiang University, the University of California, San Diego, and two other institutions. Published on the thirtieth of September. Its code repository is public and real: about thirty-five source files.

An embodied agent that keeps a persistent spatial memory can find its way around a familiar place over repeated visits. Memory, though, records where things were. Targets can move while nobody is watching, including while the agent is on its way, so a remembered location may be wrong by the time the agent gets there. Memory retrieval and state prediction have both advanced, but two things remain hard: accounting for the world continuing to change out of sight, and revising beliefs when visibility is limited. The authors frame this as Evolving-World Navigation. An agent infers where a target is from intermittent observations, predicts its state at the moment of inspection, and revises its beliefs using visual evidence.

EvolvingNav answers with a belief indexed by time. It builds that belief from timestamped 3D histories of objects, through a structured model of persistence and relocation. The belief keeps two possibilities apart: that a target has persisted at the place it was last seen, or that it has relocated somewhere else. It also holds back some probability for locations outside the set of known candidates, so the unexpected is never ruled out entirely.

An event-driven filter keeps the belief current. As time passes it propagates the belief forward, forecasts whether the target will occupy each candidate at the time it would be inspected, and folds in new RGB-D evidence. Not seeing the target counts as evidence too. A negative observation lowers the weight of a location hypothesis according to detection probabilities that are calibrated and conditioned on visibility, and evidence tracking stops the same observation from being used twice. Acting on all this is a frozen vision-language controller, used zero-shot, which reads the updated belief to choose actions and to replan.

To test the setting, the authors also introduce EvoWorld-Bench. It is grounded in traces of human activity and spans fifty-four scenes and eight hundred and three thousand six hundred and eighty tasks, with changes controlled both before and during navigation. In simulation and in experiments on a real robot, EvolvingNav improves navigation success and search efficiency over the baselines evaluated. Paired experiments find the clearest gains where the temporal patterns are learnable. Ablations show that keeping uncertainty alive, and taking visibility into account when weighing evidence, both earn their place.

A map of where things were is only half of what a returning agent needs. The other half is an expectation of where they have gone since, kept honest by what the agent sees and fails to see along the way. EvolvingNav treats memory as a forecast to be checked rather than a record to be trusted.

Paper Quest · 7 chapters · about 40 min

Play this paper

Learn it by doing: make the calls the authors made, guess the result before you see it, and defend it in a viva graded on your own words. Chapter 1 is right here.

Chapter 1 🧩 · The problem

Every quest starts with a wall. Here it is a memory that is right about the past and wrong about now.

You run a home robot that remembers where it saw things. Someone asks for the medication box, which it last saw on the bedside table yesterday.

The road ahead

  1. 1 · The problem ~6 min A robot's memory says where things were, but people move things unseen, so the remembered spot may be wrong when it arrives.
  2. 2 · What came before ~3 min
  3. 3 · The key idea ~9 min Instead of one remembered spot, the robot keeps a time-indexed probability over where the target is now and revises it with careful looks.
  4. 4 · Choose your own research ~3 min
  5. 5 · Build the method ~8 min Timestamped sightings become a time-indexed belief, which is forecast for arrival times, cut by clear empty views, and read by a frozen controller.
  6. 6 · The experiment ~6 min You’ll guess: In paired experiments, under which kind of world change did EvolvingNav show its clearest gains?
  7. 7 · The viva ~5 min Three questions from the examiners, answered in your own words. Win it for the paper’s trophy.
Join free to play the whole quest ›

Free, with Google or an email address. Your stars and progress are kept.

KipQuest: the day’s AI research, as podcasts and quests. All papers Android app Privacy Contact Episodes are written and voiced by AI from each paper. Summaries can contain mistakes: the paper is the source.