InternW0: A Foundational Physical World Model for Efficient Real-World Interactions
Jisong Cai, Yao Mu, Ganlin Yang, Zhe Cao, Zhangzheng Tu, Xing Gao, Kailin Li, Xinyu Zhan and 18 others
Shanghai AI Laboratory
Published September 23, 2026 · on the feed September 24, 2026 · ▲ 10 · arXiv 2609.27656
The abstract
Physical intelligence requires more than predicting how the world may evolve: predictions must remain actionable as the world continues to change. We introduce InternW0, the first instantiation of the InternW physical world model series from Shanghai AI Laboratory, built around omnimodal interfaces, asynchronous multi-frequency processing, and local physical modeling under partial observations and external influences. InternW0 jointly learns future visual dynamics and continuous robot control through an asymmetric video--action architecture with flow matching. A high-capacity video expert provides longer-horizon predictive context, while a lightweight action expert operates at a faster timescale. Instead of regenerating the future for every action update, InternW0 reuses layerwise K/V and adapts it to newly observed states through observation-conditioned context routing. Domain-specific interfaces and soft prompts support heterogeneous embodiments, while contact-aware post-training incorporates force and tactile signals for contact-rich manipulation. We train InternW0 on approximately 7,200 hours of heterogeneous robot and egocentric data, including EgoLab, a 275-hour real-laboratory egocentric dataset. Evaluation spans simulation benchmarks and real-world scientific tasks, including a 15-stage metal--organic framework synthesis workflow and 5-stage contact- and force-aware dexterous manipulation for general-purpose quantitative pipetting. These results advance scalable, asynchronous, and science-native physical world models for universal and efficient real-world interactions.
The Brief
2:40A short podcast summary of the paper. Written and voiced by AI.
Transcript
InternW0. A Foundational Physical World Model for Efficient Real-World Interactions. By Jisong Cai and twenty-five others, from the Shanghai AI Laboratory. Published on the twenty-third of September. No code repository is linked to it.
Physical intelligence requires more than predicting how the world may evolve. The predictions have to remain actionable while the world keeps changing. A forecast that arrives after the scene has moved on is no help to a robot that has to act now. The design problem is to keep prediction useful at the speed that control requires.
InternW0 is the first instantiation of the InternW physical world model series from Shanghai AI Laboratory. It is built around omnimodal interfaces, asynchronous processing at multiple frequencies, and local physical modeling under partial observations and external influences. It learns future visual dynamics and continuous robot control jointly, through an asymmetric video and action architecture with flow matching. A high-capacity video expert provides longer-horizon predictive context, while a lightweight action expert operates at a faster timescale. The split mirrors the problem. Looking ahead is expensive and can run slower. Acting has to be quick, and is kept light.
Rather than regenerating the future for every action update, InternW0 reuses its layerwise K and V, and adapts them to newly observed states through observation- conditioned context routing. Domain-specific interfaces and soft prompts support heterogeneous embodiments. Contact-aware post-training brings in force and tactile signals, for contact-rich manipulation. The reuse is what lets the fast expert keep pace. The expensive predictive context is carried forward and adjusted to the latest observation, instead of being produced again from scratch each time the action changes.
Training uses about seven thousand two hundred hours of heterogeneous robot and egocentric data. That includes EgoLab, a real-laboratory egocentric dataset of two hundred seventy-five hours. Evaluation spans simulation benchmarks and real- world scientific tasks. One is a fifteen-stage workflow for synthesizing a metal-organic framework. Another is five-stage dexterous manipulation for general-purpose quantitative pipetting, aware of contact and force. These are long, multi-step procedures from a real laboratory, the kind of setting where a robot's model of the world has to stay current from one stage to the next.
The emphasis throughout is on keeping prediction and action in step. A slow expert looks further ahead, a fast one acts, and earlier context is adapted rather than rebuilt. The authors present this as advancing scalable, asynchronous physical world models that are native to science.
Paper Quest · 7 chapters · about 36 min
Play this paper
Learn it by doing: make the calls the authors made, guess the result before you see it, and defend it in a viva graded on your own words. Chapter 1 is right here.
Chapter 1 🧩 · The problem
Seeing ahead is slow. Acting must be fast. A lab robot has to do both.
You are building a robot for a real chemistry lab. It needs to imagine how the scene will unfold, and imagining future video with a large model is slow.
The road ahead
- 1 · The problem ~6 min A robot in a changing lab needs foresight, but slow video forecasts arrive too late to guide what it must do right now.
- 2 · What came before ~3 min
- 3 · The key idea ~8 min Split looking ahead from acting: a big video expert forecasts slowly, a light action expert acts fast, reusing and updating the forecast's stored context.
- 4 · Choose your own research ~3 min
- 5 · Build the method ~8 min The video expert forecasts and stores K/V, action updates reuse it, each chunk corrects it with its new view, and the action expert acts.
- 6 · Field test ~3 min
- 7 · The viva ~5 min Three questions from the examiners, answered in your own words. Win it for the paper’s trophy.
Free, with Google or an email address. Your stars and progress are kept.