PhysVista: Benchmarking Physical Intelligence in VLMs via a Perception-Reasoning-Assessment Loop
Xinge Peng, Yiting Lu, Tianwu Zhi, Wen Wen, Jianzhao Liu, Xin Li, Zhibo Chen
University of Science and Technology of China · ByteDance · City University of Hong Kong
Published September 30, 2026 · on the feed October 2, 2026 · ▲ 24 · arXiv 2610.00559
The abstract
Vision-Language Models (VLMs) have shown strong multimodal reasoning capabilities, yet whether they truly capture the physical consistency underlying real-world dynamics remains unclear. Existing benchmark paradigms often suffer from fragmented evaluation, focusing on isolated cognitive stages while overlooking the inherent synergy between perception, reasoning, and physical judgment. The lack of a holistic perspective limits the ability to diagnose whether VLMs can reliably evaluate the physical authenticity of emerging generative models. To address these issues, we introduce PhysVista, a benchmark designed to evaluate physical intelligence in VLMs through a closed cognitive loop framework inspired by the human seeing-reasoning-assessment process. PhysVista restores this loop by jointly evaluating physical state perception, physical dynamics reasoning, and physical plausibility assessment. It further distinguishes event-level reasoning and scale-level reasoning to enable fine-grained analysis of physical understanding. In addition, PhysVista incorporates both real-world and AI-generated videos, allowing evaluation across diverse domains and emerging generative scenarios. Extensive experiments across a diverse set of VLMs reveal substantial limitations in physical reasoning and plausibility assessment, highlighting a persistent gap between visual recognition and genuine physical understanding, and pointing toward more principled designs for physically grounded multimodal intelligence.
The Brief
2:16A short podcast summary of the paper. Written and voiced by AI.
Transcript
PhysVista. Benchmarking Physical Intelligence in VLMs via a Perception-Reasoning-Assessment Loop. By Xinge Peng and six others, from the University of Science and Technology of China, ByteDance, and one other institution. Published on the thirtieth of September. Its code repository is a placeholder: a readme, and nothing to run yet.
Vision-language models show strong multimodal reasoning, but whether they truly capture the physical consistency behind real-world dynamics is still unclear. Existing benchmarks tend to evaluate in fragments. They focus on isolated cognitive stages, testing one step at a time, and overlook how perception, reasoning and physical judgment work together as a whole. That missing holistic view has a practical cost. It makes it hard to diagnose whether these models can reliably judge the physical authenticity of what emerging generative models produce.
PhysVista evaluates physical intelligence through a closed cognitive loop, inspired by the way a person sees, then reasons, then assesses. It restores that loop by evaluating three stages jointly rather than one at a time. The first is perception of physical state: what is there, and in what condition. The second is reasoning about physical dynamics: how things will move and change. The third is assessment of physical plausibility: whether what was shown could really happen.
Reasoning is divided further, into event-level reasoning and scale-level reasoning, which allows a finer-grained analysis of where physical understanding holds and where it breaks. The videos come from two sources: the real world, and AI-generated content. That mix lets the benchmark span diverse domains as well as the newer scenarios that generative models create, which matters for a benchmark partly meant to test whether a model can judge generated video.
Extensive experiments across a diverse set of vision-language models reveal substantial limitations, in physical reasoning and in plausibility assessment alike. The authors read the results as a persistent gap between visual recognition and genuine physical understanding.
A model can recognise what is in a clip and still miss that the clip breaks physics. PhysVista is built to pull those two abilities apart and score them separately, and the experiments reported find the first running ahead of the second. From there the authors point toward more principled designs for multimodal intelligence that is physically grounded.
Paper Quest · 7 chapters · about 36 min
Play this paper
Learn it by doing: make the calls the authors made, guess the result before you see it, and defend it in a viva graded on your own words. Chapter 1 is right here.
Chapter 1 🧩 · The problem
Every quest starts with a wall. Here it is a model that sees well but may not understand what it sees.
You want to know whether vision-language models really understand physics in video, for instance whether they can tell that an AI-generated clip shows something that could never happen.
The road ahead
- 1 · The problem ~7 min To know if a vision-language model understands physics in video, you need a test that shows where its understanding breaks, not just a single score.
- 2 · What came before ~3 min
- 3 · The key idea ~9 min PhysVista tests seeing, reasoning and judging together on the same models, using real and AI-generated videos, so gaps between stages show up.
- 4 · Choose your own research ~3 min
- 5 · How it works ~3 min
- 6 · The experiment ~6 min You’ll guess: On a physics benchmark spanning seeing, reasoning and plausibility judgment, where did today's vision-language models fall down most?
- 7 · The viva ~5 min Three questions from the examiners, answered in your own words. Win it for the paper’s trophy.
Free, with Google or an email address. Your stars and progress are kept.