Physis-Lang: Self-Evolving Language as a Physical Representation for Video World Model

Liming Lu, Xianzheng Ma, Wenkun He, Guanqi Zhan, Yilin Zhao, Junyu Chen, Mengyao Xu, Jiaojiao Fan and 9 others

NVIDIA · MIT · University of Oxford

Published September 30, 2026 · on the feed October 1, 2026 · ▲ 14 · arXiv 2609.40358

Video3D, worlds & games No code arXiv ↗Hugging Face ↗

The abstract

Video world models are expected to predict how the physical world evolves, yet they often produce visually plausible videos that violate basic physical principles. Existing approaches commonly assume that natural language is insufficient to represent the physical knowledge required for reliable generation, and therefore introduce additional visual, latent, numerical, or planning-based signals. We revisit this assumption and introduce Physis-Lang, a self-evolving framework that treats physical language as a shared and optimizable representation across data curation, model training, and video generation. Physis-Lang represents physical processes through language that describes their relevant entities, causes, interactions, governing principles, temporal evolution, and effects. To improve this representation, we construct PhysCapBench, which decomposes physical processes into atomic assertions and evaluates captions using recall and precision. An agentic loop iteratively analyzes assertion-level errors and refines the instruction used to produce physical captions. Physis-Lang further converts model deficiencies into textual descriptions and uses language-guided retrieval to identify visually diverse videos that cover missing physical processes. Experiments on four widely used physical video benchmarks with Wan and Cosmos backbones demonstrate consistent improvements in physical plausibility. Notably, starting from open-source Cosmos3-Nano backbones, our Physis-Lang-enhanced models surpass the leading proprietary Veo 3.1 model.

The Brief

2:29

A short podcast summary of the paper. Written and voiced by AI.

Transcript

Physis-Lang. Self-Evolving Language as a Physical Representation for Video World Model. By Liming Lu and sixteen others, from NVIDIA, MIT, and one other institution. Published on the thirtieth of September. No code repository is linked to it.

A video world model is supposed to predict how the physical world evolves. In practice these models often produce videos that look plausible and still break basic physical principles. The common response assumes that natural language cannot carry the physical knowledge reliable generation needs, and so it brings in extra signals: visual ones, latent ones, numerical ones, or signals based on planning. Each of those adds another channel next to the text, on the premise that words alone run out before the physics does.

Physis-Lang revisits that assumption. It treats physical language as the representation, one that is shared and can be optimised across the whole pipeline: curating data, training the model, and generating video. A physical process is described in language that covers its relevant entities, its causes, the interactions involved, the principles that govern it, how it unfolds over time, and its effects. The bet is that a description rich enough along those lines can carry what generation needs, and that the description itself can be made better over time, which is where the self-evolving part of the name comes from.

Because the representation is meant to improve, it needs a measure. That is PhysCapBench, which breaks a physical process down into atomic assertions and scores captions by recall and precision over them. An agentic loop then analyses errors at the level of those assertions and iteratively refines the instruction used to produce physical captions. The same language also points the data in the right direction. Physis-Lang converts the model's deficiencies into textual descriptions, and uses retrieval guided by that language to find visually diverse videos covering the physical processes that are missing.

Experiments run on four widely used physical video benchmarks, with Wan and with Cosmos backbones, and show consistent improvements in physical plausibility. Starting from open-source Cosmos3-Nano backbones, the models enhanced with Physis-Lang surpass the leading proprietary model, Veo three point one.

Where others add new kinds of signal, this work asks more of the one already there. Language describes the physics, a benchmark grades the description, a loop rewrites the captioning instruction, and the model's own failures, put into words, decide which videos it sees next. Every turn of that cycle is written in words, and the words are what keep getting better.

Paper Quest · 7 chapters · about 41 min

Play this paper

Learn it by doing: make the calls the authors made, guess the result before you see it, and defend it in a viva graded on your own words. Chapter 1 is right here.

Chapter 1 🧩 · The problem

Videos that look right and move wrong. That is the wall here.

You train a video generation model. Its clips look real, yet objects vanish, collisions end wrongly, and fluids move unnaturally. Its training text describes what is visible, not why things happen.

The road ahead

  1. 1 · The problem ~7 min Video models make clips that look real but break physics, because their training text only says what is visible, and the usual fixes add extra channels.
  2. 2 · What came before ~3 min
  3. 3 · The key idea ~9 min Make language itself the physics representation: rich descriptions of causes, laws and effects, scored, refined by an agent, and reused to pick training videos.
  4. 4 · Choose your own research ~3 min
  5. 5 · Build the method ~8 min Write physics-rich captions, score them on atomic assertions, evolve the instruction, then turn model failures into text to retrieve missing kinds of videos.
  6. 6 · The experiment ~6 min You’ll guess: Starting from open-source Cosmos3-Nano backbones, how did Physis-Lang-enhanced models compare with the leading proprietary model, Veo 3.1?
  7. 7 · The viva ~5 min Three questions from the examiners, answered in your own words. Win it for the paper’s trophy.
Join free to play the whole quest ›

Free, with Google or an email address. Your stars and progress are kept.

KipQuest: the day’s AI research, as podcasts and quests. All papers Android app Privacy Contact Episodes are written and voiced by AI from each paper. Summaries can contain mistakes: the paper is the source.