Toward the Era of Agentic Embodied Intelligence
Chao Liang, Ke Chen, Fengxiaoxiao Li, Shibo Huang, Yufeng Sun, Zhaokai Yin, Jianhuan Lai, Haozhe Feng and 2 others
Shanghai Jiao Tong University · Anyverse Dynamics
Published November 6, 2026 · on the feed November 9, 2026 · ▲ 53 · arXiv 2611.09124
The abstract
Foundation models increasingly guide robot actions, yet sustained autonomy requires efficient control and failure recovery. We introduce A2-MEAS, an embodied multi-agent framework built around code as a scaling interface. Learned correction codes combine corrective language, spatial evidence, execution history, and action proposals. MetaBrain provides training supervision and runtime guidance. A correction encoder and adapter absorb this knowledge into policy weights during training, while fresh codes adapt behavior with frozen weights at deployment. The action model, A2-WLA, adds motion-aware history and a latent world model to a vision-language-action policy. Surprisingly, this simple design with action pretraining and task specialization reaches 0.5755 Q-score on the 50-task BEHAVIOR 2026 public subset before online correction, 2.21x the 2025 winner's reported 0.2605 across different benchmark editions and training configurations. On all 100 BEHAVIOR 2026 public tasks, A2-MEAS achieves 0.6411 Q-score and 45.40% task success. On RoboTwin 2.0, A2-WLA achieves 93.98% average success, rising to 95.05% with the complete system. Across 12 real-robot tasks in five household settings, A2-WLA achieves 57.92% average success versus 26.67% for pi0.5. In long-horizon pour-over coffee preparation, a history-conditioned adapter raises post-failure completion at two filter-handling steps from 14% to 94% and from 8% to 82%, compared with A2-WLA retries. Our training infrastructure delivers 427.1 samples per second, 4.03x the throughput of a pi0.5 reference implementation on matched hardware. We will release the system, models, training scripts, and infrastructure to support efficient embodied learning.
The Brief
2:52A short podcast summary of the paper. Written and voiced by AI.
Transcript
Toward the Era of Agentic Embodied Intelligence. By Chao Liang and nine others, from Shanghai Jiao Tong University and Anyverse Dynamics. Published on the sixth of November.
Foundation models increasingly decide what robots do. But keeping a robot autonomous over a sustained stretch asks for two more things: control that is efficient, and the ability to recover when something fails.
A2-MEAS is an embodied multi-agent framework built around one organising choice: code as the scaling interface. Its central object is a learned correction code, which bundles together corrective language, spatial evidence, the history of execution, and proposed actions. A component called MetaBrain supplies those codes in two roles. During training it provides supervision, and at runtime it provides guidance.
The knowledge moves in two ways. In training, a correction encoder and an adapter absorb it into the policy's weights. At deployment, the weights stay frozen and fresh codes adapt the behavior instead. The action model itself, A2-WLA, takes a vision-language-action policy and adds two things: a motion-aware history and a latent world model.
The authors call this design simple and say its strength was a surprise. With action pretraining and task specialization, and before any online correction, it reaches a Q-score of zero point five seven five five on the fifty-task public subset of BEHAVIOR two thousand twenty-six. That is two point two one times the zero point two six zero five reported by the two thousand twenty-five winner, though the abstract notes the comparison crosses benchmark editions and training configurations.
On all one hundred public tasks, the full A2-MEAS reaches a Q-score of zero point six four one one and a task success of forty-five point four percent. On RoboTwin two point zero, A2-WLA alone averages ninety-three point nine eight percent success, and the complete system lifts that to ninety-five point zero five percent.
On real robots, across twelve tasks in five household settings, A2-WLA averages fifty-seven point nine two percent success. The comparison, pi zero point five, averages twenty-six point six seven percent. In a long-horizon task, preparing pour-over coffee, a history-conditioned adapter changes what happens after a failure at two filter-handling steps. Compared with A2-WLA simply retrying, completion at the first step rises from fourteen percent to ninety-four. At the second it rises from eight percent to eighty-two.
The training infrastructure is measured too. It delivers four hundred and twenty-seven point one samples per second, which is four point zero three times the throughput of a pi zero point five reference implementation on matched hardware.
The thread through all of this is a single interface doing two jobs. The same correction codes that get folded into the weights while training are the ones that steer a frozen policy once it is deployed, so behavior can change in the field while the weights stay fixed. The authors say they will release the system, the models, the training scripts and the infrastructure.
Paper Quest · 7 chapters · about 41 min
Play this paper
Learn it by doing: make the calls the authors made, guess the result before you see it, and defend it in a viva graded on your own words. Chapter 1 is right here.
Chapter 1 🧩 · The problem
Long tasks break in the middle. The hard part is what the robot does next.
Your robot policy handles single steps well, but over a long household activity things go wrong: a grasp slips, a filter lands crooked, and each fix changes what comes next.
The road ahead
- 1 · The problem ~7 min A robot policy that does single steps well still stumbles over long activities, and a diagnosis in words does not by itself change its motion.
- 2 · What came before ~3 min
- 3 · The key idea ~9 min A learned correction code carries a diagnosis and its evidence into the action model's hidden states, trained in once, then fed fresh at deployment.
- 4 · Choose your own research ~3 min
- 5 · Build the method ~8 min Build a strong action model, mine corrections with MetaBrain, train a small encoder and adapter on them, then freeze everything and feed fresh codes.
- 6 · The experiment ~6 min You’ll guess: In pour-over coffee preparation, plain A2-WLA retries completed the first filter-handling step after a failure 14% of the time. How often did the history-conditioned adapter manage it?
- 7 · The viva ~5 min Three questions from the examiners, answered in your own words. Win it for the paper’s trophy.
Free, with Google or an email address. Your stars and progress are kept.