OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining
Yuran Wang, Siqiao Huang, Mingleyang Li, Chenhao Zhang, Jiaqi Liang, Weiyang Jin, Yue Chen, Xuemin Chi and 16 others
National University of Singapore · Tsinghua University · Peking University · The University of Hong Kong · Zhejiang University · The Chinese University of Hong Kong
Published September 7, 2026 · on the feed September 9, 2026 · ▲ 76 · arXiv 2609.07398
The abstract
World-Action Models inherit world knowledge from video-generative priors, and channel it into executable control signals through embodied experience. Existing systems, however, are monolithic: the generative backbone, visual representation, architecture, information flow, inference procedure, and training data are tightly coupled, obscuring which design choices matter and why. We introduce OpenWAM, an open research stack that turns world-action pretraining into a controlled experimental program. OpenWAM-Infra factorizes the WAM design space into composable modules with unified training, inference, deployment, and evaluation. On this substrate, OpenWAM-Study examines three questions through controlled experiments: what to inherit, how world and action learning interact, and how their synergy scales; and distills three principles: upstream knowledge transfers through a sufficiently capable generative backbone and a compact, information-rich latent space; world-action synergy requires dedicated action capacity, explicit world-to-action information flow, and synchronized joint denoising; and embodied pretraining principally improves out-of-domain generalization, with one-stage co-training over egocentric and robot data integrating world coverage and action grounding. Composing these principles, we build OpenWAM-α, an open WAM pretrained on roughly 6,400 hours of egocentric human and robot data and evaluated across simulation and real-world benchmarks. Across the eight simulation benchmarks and the real-robot experiments, which together span embodiments from single-arm and bimanual manipulation to dexterous hands, OpenWAM-α delivers consistently excellent performance, sustaining its top-tier standing from simulation to the physical world. We release the full stack, including infrastructure, evaluation protocols, pretrained models, and data recipes, to facilitate future research.
The Brief
3:14A short podcast summary of the paper. Written and voiced by AI.
Transcript
OpenWAM. An Open, Modular Exploration Towards Systematic World-Action Model Pretraining. By Yuran Wang and twenty-three others, from the National University of Singapore, Tsinghua University, and five other institutions. Published on the seventh of September. Its code repository is worked out: about four hundred and fifty source files, with a readme and a licence.
World-Action Models inherit knowledge of the world from video-generative priors and channel it, through embodied experience, into executable control signals. Existing systems are monolithic. The generative backbone, the visual representation, the architecture, the information flow, the inference procedure, and the training data are all tightly coupled, which hides which design choices matter and why. When everything changes together, a better result cannot be traced to any one decision. OpenWAM is an open research stack that turns world-action pretraining into a controlled experimental program, and its study distills three principles.
First, upstream knowledge transfers through a sufficiently capable generative backbone and a compact, information-rich latent space. Second, synergy between world and action learning requires dedicated action capacity, explicit information flow from world to action, and synchronised joint denoising. Third, embodied pretraining mainly improves out-of-domain generalisation, and one-stage co-training over egocentric and robot data integrates coverage of the world with grounding of actions. Read together, the principles say where knowledge comes from, how the world half and the action half must be wired to help each other, and what embodied data adds on top.
The stack has two parts. OpenWAM-Infra factorises the design space into composable modules, with unified training, inference, deployment and evaluation. On that substrate, OpenWAM-Study runs controlled experiments on three questions: what to inherit, how world and action learning interact, and how their synergy scales. Those experiments are the source of the principles. Because each module can be swapped while the others stay fixed, a difference in outcome can be attributed to the module that changed, which is what makes the study controlled.
Those principles are then composed into a model, OpenWAM alpha, pretrained on roughly six thousand four hundred hours of egocentric human and robot data. It is evaluated on eight simulation benchmarks and in real-robot experiments, spanning embodiments from single-arm and bimanual manipulation to dexterous hands. Across all of them it delivers consistently excellent performance, keeping its top-tier standing from simulation into the physical world.
The principles come from the design space the modules cover and the questions the study asked, and the third principle is specific about what embodied pretraining improves: principally generalisation out of domain. The model's standing is reported on the eight simulation benchmarks and the real-robot experiments described. The full stack is released, including infrastructure, evaluation protocols, pretrained models, and data recipes, so the experiments can be extended.
The contribution is as much a way of working as a result. Decoupling a world- action model into swappable parts makes it possible to ask which part matters, and the three principles are what that questioning produced. The released model is those principles put together.
Paper Quest · 7 chapters · about 40 min
Play this paper
Learn it by doing: make the calls the authors made, guess the result before you see it, and defend it in a viva graded on your own words. Chapter 1 is right here.
Chapter 1 🧩 · The problem
Good robot models exist, yet nobody can say why they work. That is the wall.
You build robot policies that borrow what video generators know about how the world moves, and turn it into control signals.
The road ahead
- 1 · The problem ~7 min Robot policies built on video generators work, but every part is changed at once, so nobody can tell which choice made them work.
- 2 · What came before ~3 min
- 3 · The key idea ~8 min Take the system apart into swappable modules, change one at a time, distil principles, then compose them into one pretrained model.
- 4 · Choose your own research ~3 min
- 5 · Build the method ~8 min Modularise, run controlled studies on three questions, distil principles, compose them into one model, pretrain it on human and robot data, then evaluate widely.
- 6 · The experiment ~6 min You’ll guess: According to the study, what does embodied pretraining principally improve in these models?
- 7 · The viva ~5 min Three questions from the examiners, answered in your own words. Win it for the paper’s trophy.
Free, with Google or an email address. Your stars and progress are kept.