RoboFoundry: System-as-Policy Evolution for Self-Learning Embodied Agents
Jingsong Liang, Shuhao Liao, Shizhe Zhang, Diyuan Hou, Yuxin Cai, Xinjian Deng, Chengyang He, Wenhui Huang and 10 others
Nanyang Technological University · Beihang University · National University of Singapore · Cloud Butterfly Technology · Shanghai Jiao Tong University
Published September 26, 2026 · on the feed September 29, 2026 · ▲ 25 · arXiv 2609.32862
The abstract
A foundation model should not act in isolation as an embodied agent. Yet, existing methods often optimize individual components of the agent stack, such as memory, context, skills, or action interfaces, rather than treating the supporting system itself as a unified policy. Moreover, interaction alone does not yield self-improvement unless execution experience is converted into persistent, validated system changes. We therefore propose RoboFoundry, the first embodied agentic framework that formulates this process as Self-Evolving System-as-Policy. RoboFoundry diagnoses capability gaps in decision-making and memory management, converts execution traces into validated task-specific system updates, and promotes recurring improvements to the general system. Evolution operates over two complementary surfaces: a context system that manages active internal context and persistent file-system memory, and a hierarchical skill system that organizes atomic skills, reusable compositions, and failure-conditioned recovery. A shared semantic interface separates embodiment-invariant decisions from embodiment-specific execution, allowing evolved system capabilities to transfer across heterogeneous robots. On EmbodiedBench, RoboFoundry achieves state-of-the-art performance, notably improving GPT-5.5 by 27.8%. It also brings Qwen3.7-Plus to near parity with GPT-5.5 (70.3% vs. 72.7%), showing consistent gains from system-as-policy evolution across foundation models. For long-horizon memory, RoboFoundry outperforms all baselines on RoboMemArena by at least 39.0%, even against methods assisted by external foundation models. On LIBERO-PRO, it further outperforms Cap-Agent0 by 243.8%-679.7% across all perturbation types. In real-world deployments, RoboFoundry demonstrates zero-shot transfer and online evolution across robots and tasks, highlighting its potential for fully autonomous embodied agents.
The Brief
3:14A short podcast summary of the paper. Written and voiced by AI.
Transcript
RoboFoundry. System-as-Policy Evolution for Self-Learning Embodied Agents. By Jingsong Liang and seventeen others, from Nanyang Technological University, Beihang University, and three other institutions. Published on the twenty-sixth of September. No code repository is linked to it.
The opening position is that a foundation model should not act alone as an embodied agent. Around it sits a stack: memory, context, skills, action interfaces. Existing methods tend to optimise one of those parts at a time, rather than treating the supporting system as a single policy. There is a second gap. Interaction by itself does not make an agent better. Improvement only happens when execution experience is turned into changes to the system that persist and have been validated. An agent can act many times and end up exactly where it started, if nothing it went through is written back into the system that shapes its next attempt.
RoboFoundry, described as the first embodied agentic framework of its kind, formulates that process as a Self-Evolving System-as-Policy. The whole supporting system is what gets improved. It diagnoses gaps in capability, both in decision-making and in how memory is managed. It converts execution traces into validated updates specific to a task. And improvements that keep recurring are promoted into the general system. There are two tiers, then. A fix begins life as something validated for a particular task, and only when it keeps proving useful does it graduate into the system that every task shares.
Evolution happens on two complementary surfaces. One is a context system, which manages the active internal context and a persistent memory kept in a file system. The other is a hierarchical skill system, which organises atomic skills, reusable compositions of them, and recovery routines conditioned on failure. Underneath both lies a shared semantic interface that separates decisions that do not depend on the body from execution that does. That separation is what lets evolved capabilities transfer across robots of different kinds.
On EmbodiedBench, RoboFoundry reports state-of-the-art performance, notably improving GPT-5.5 by twenty-seven point eight percent. It brings Qwen3.7-Plus to near parity with GPT-5.5, seventy point three percent against seventy-two point seven, which the authors take as consistent gains across foundation models. For long-horizon memory, it beats every baseline on RoboMemArena by at least thirty-nine percent, including methods assisted by external foundation models.
On LIBERO-PRO it outperforms Cap-Agent0 by between two hundred forty-three point eight and six hundred seventy-nine point seven percent, and that holds across every perturbation type rather than a favourable few. Off the simulator, in real-world deployments, it shows zero-shot transfer and online evolution across robots and tasks. Those last two go together: the system carries what it has learned to a new robot, and keeps evolving once it is there.
Treat the scaffolding as the thing being learned, and the question shifts from which model to use to how the system around it grows. RoboFoundry's answer is a loop of diagnosis, validated updates, and promotion, split between context and skills, and held apart from any one robot's body. The authors present it as a step toward fully autonomous embodied agents.
Paper Quest · 7 chapters · about 40 min
Play this paper
Learn it by doing: make the calls the authors made, guess the result before you see it, and defend it in a viva graded on your own words. Chapter 1 is right here.
Chapter 1 🧩 · The problem
A model alone does not make a robot agent. Here is the wall.
You run a robot agent driven by a frozen foundation model. Around the model sits a stack: memory, context, skills and action interfaces, and the same model behaves very differently depending on that stack.
The road ahead
- 1 · The problem ~6 min A robot agent's behaviour depends on the whole stack around its frozen model, yet that stack is improved piece by piece and never learns from experience.
- 2 · What came before ~3 min
- 3 · The key idea ~9 min Treat the model's whole supporting system as the policy, and evolve it from execution traces in validated task fixes and promoted general rules.
- 4 · Choose your own research ~3 min
- 5 · Build the method ~8 min Diagnose the gap from a trace, validate a task-specific edit in a new run, then promote edits that also work on other tasks.
- 6 · The experiment ~6 min You’ll guess: On EmbodiedBench, by how much did RoboFoundry's self-evolving system-as-policy improve GPT-5.5?
- 7 · The viva ~5 min Three questions from the examiners, answered in your own words. Win it for the paper’s trophy.
Free, with Google or an email address. Your stars and progress are kept.