EmbodiedSkills: A Unified Framework for Orchestrating, Training, and Deploying VLA Agents

Wei Wang, Wenqiao Zhang, Yutong Lin, Yuqian Yuan, Tianwei Lin, Jinhao Mao, Zhenxuan Fan, Mingjian Gao and 9 others

Zhejiang University · Nanjing University of Aeronautics and Astronautics · Cornell University · Universal Ubiquitous AI Co., Ltd. · National University of Singapore · Hangzhou DEEP Robotics Technology Co., Ltd.

Published September 1, 2026 · on the feed September 8, 2026 · ▲ 14 · arXiv 2609.01281

Robotics & embodiedAgentsVision & multimodal Full code arXiv ↗Hugging Face ↗

The abstract

Vision-language-action (VLA) models map visual observations and language instructions directly to robot actions, but long-horizon tasks require more than action prediction. An agent must coordinate perception, planning, execution, progress verification, and recovery as the physical state evolves. An action prediction or a model-generated skill decision does not, by itself, guarantee that the proposed operation is valid in the current state or that its outcome will be verified. We propose EmbodiedSkills, a unified framework that treats each skill decision as an execution proposal: the runtime checks its prerequisites before execution and verifies the outcome afterward. A shared executable-skill interface connects high-level skill selection, bounded low-level VLA execution, and post-action verification within a single agent loop. Because this interface remains fixed, low-level VLA policies can be replaced or adapted without changing the agent loop. The interface also records planning, execution, verification, and recovery events as structured trajectories, which provide supervision for individual components and can support optional online adaptation when interactive feedback is available. We instantiate EmbodiedSkills with Qwen3-VL and OpenPI/pi0.5 on RoboTwin 2.0 and LIBERO. Task-adapted low-level VLA policies achieve an average success rate of 86.20% across 50 RoboTwin 2.0 tasks and 97.40% across the four LIBERO suites. These results establish the execution performance of the task-adapted low-level VLA policies used in EmbodiedSkills. On four memory-dependent RMBench tasks, the same task-adapted execution approach achieves 12.5% average success. The framework provides a trainable and inspectable agent layer for turning these policies into closed-loop embodied systems.

The Brief

3:10

A short podcast summary of the paper. Written and voiced by AI.

Transcript

EmbodiedSkills. A Unified Framework for Orchestrating, Training, and Deploying VLA Agents. By Wei Wang and sixteen others, from Zhejiang University, the Nanjing University of Aeronautics and Astronautics, and four other institutions. Published on the first of September. Its code repository is worked out: about sixty-five source files, with a readme.

Vision-language-action models, VLA models for short, map what a robot sees and the instruction it is given directly to actions. For long-horizon tasks that is not enough. An agent has to coordinate perception, planning, execution, checking its own progress, and recovering when something goes wrong, all while the physical state keeps changing underneath it. A predicted action, or a skill decision generated by a model, does not by itself guarantee that the operation is valid in the state the robot is actually in. Nor does it guarantee anyone will check whether it worked.

EmbodiedSkills reframes every skill decision as an execution proposal rather than a command. Before the skill runs, the runtime checks its prerequisites. After it runs, the runtime verifies the outcome. A decision is something to be tested against the world on both sides, not simply carried out. The two checks answer the two gaps in the problem directly. The prerequisite check asks whether this operation is valid in the current state. The verification asks whether the outcome actually happened. Neither question is left to the model that proposed the skill in the first place.

The piece that holds this together is a shared executable-skill interface. It connects three layers inside a single agent loop: high-level skill selection, bounded low-level execution by a VLA policy, and verification after the action. Because that interface stays fixed, the low-level VLA policies can be swapped out or adapted without touching the loop around them.

The interface does a second job as well. It records planning, execution, verification and recovery events as structured trajectories. Those records provide supervision for individual components, and when interactive feedback is available they can support optional online adaptation. So the loop that runs the robot is also the source of data for improving its parts.

The framework is instantiated with Qwen3-VL and with OpenPI, specifically pi0.5, and tested on RoboTwin 2.0 and LIBERO. Task-adapted low-level VLA policies reach an average success rate of eighty-six point two percent across fifty RoboTwin tasks. On the four LIBERO suites the average is ninety-seven point four percent.

The authors are careful about what these numbers establish: the execution performance of the task-adapted low-level policies used inside EmbodiedSkills. A harder test comes from four memory-dependent tasks in RMBench, where the same task-adapted execution approach achieves twelve point five percent average success. That gap between the two sets of results is part of the report, not hidden from it.

What is on offer is a layer rather than a policy. The VLA models underneath do the moving. EmbodiedSkills sits above them as an agent layer that is trainable and inspectable, checking before and verifying after, and recording everything it does. The stated aim is to turn capable low-level policies into closed-loop embodied systems, where each step is proposed, checked and confirmed instead of simply predicted.

Paper Quest · 7 chapters · about 41 min

Play this paper

Learn it by doing: make the calls the authors made, guess the result before you see it, and defend it in a viva graded on your own words. Chapter 1 is right here.

Chapter 1 🧩 · The problem

Every quest starts with a wall. Here it is a robot that does whatever its model says.

You are building a robot that must 'place the container on the plate'. A model sees the scene and proposes the next skill, and a low-level policy turns it into motion.

The road ahead

  1. 1 · The problem ~7 min A model can name the next robot skill, but nothing makes sure that skill fits the moment or that it actually worked.
  2. 2 · What came before ~3 min
  3. 3 · The key idea ~9 min Treat every skill decision as a proposal: the runtime checks it before it runs and verifies the outcome after.
  4. 4 · Choose your own research ~3 min
  5. 5 · Build the method ~8 min Each loop step selects a skill, checks it, executes a bounded action chunk, verifies the result, and records it all.
  6. 6 · The experiment ~6 min You’ll guess: On four memory-dependent RMBench tasks, what average success did the same task-adapted execution approach reach?
  7. 7 · The viva ~5 min Three questions from the examiners, answered in your own words. Win it for the paper’s trophy.
Join free to play the whole quest ›

Free, with Google or an email address. Your stars and progress are kept.

KipQuest: the day’s AI research, as podcasts and quests. All papers Android app Privacy Contact Episodes are written and voiced by AI from each paper. Summaries can contain mistakes: the paper is the source.