Uranus: Building the Next-Generation Simulation Infrastructure for Embodied AI

Wenkang Qin, Yukun Zhou, Noah Shen, Jisong Cai, Dongxiao Mao, Baicheng Li, Yue Zhang, Wei Sui

D-Robotics

Published September 23, 2026 · on the feed September 24, 2026 · ▲ 2 · arXiv 2609.24815

Robotics & embodiedCode & software Code arXiv ↗Hugging Face ↗Weights ↗

The abstract

Scalable simulation is essential for robot data generation, policy training, evaluation, and safe iteration, yet real-world interaction is costly and conventional simulators require labor-intensive construction. We present Uranus, a data-driven robot simulator built around a joint-trajectory-conditioned autoregressive diffusion model. Uranus offers three key capabilities: (1) streaming, open-ended rollout, which receives future joint-position trajectories online and autoregressively generates one latent frame per step, corresponding to four RGB frames, without a fixed horizon; (2) low-latency generation, achieving 24 FPS after inference optimization; and (3) scalable, extensible robot control, providing a unified interface for synchronized multi-view generation across diverse robot embodiments and camera configurations. We conduct comprehensive quantitative and qualitative evaluations on both in-distribution and out-of-distribution data, providing an objective assessment of Uranus and clearly identifying its current limitations. We release the code and model weights to empower the community with practical tools and insights.

The Brief

1:58

A short podcast summary of the paper. Written and voiced by AI.

Transcript

Uranus. Building the Next-Generation Simulation Infrastructure for Embodied AI. By Wenkang Qin and seven others, from D-Robotics. Published on the twenty-third of September. Its code repository is public and real: about thirty source files.

Scalable simulation matters for generating robot data, training policies, evaluating them, and iterating safely. Real-world interaction is costly, and conventional simulators require labor-intensive construction. Something that scales has to avoid both. It cannot lean on expensive time with real hardware, and it cannot wait on people to build every scene by hand.

Uranus is a data-driven robot simulator. At its core is an autoregressive diffusion model conditioned on joint trajectories. Instead of a world built by hand, the simulator learns to generate what happens given how the robot's joints move.

The authors describe three capabilities. First, streaming, open-ended rollout. Uranus receives future joint-position trajectories online and autoregressively generates one latent frame per step, corresponding to four RGB frames, with no fixed horizon. Second, low-latency generation, reaching twenty-four frames per second after inference optimization. Third, scalable and extensible robot control, through a unified interface for synchronized multi-view generation across diverse robot embodiments and camera configurations.

Evaluation is both quantitative and qualitative, on in-distribution and out-of- distribution data. The authors present it as an objective assessment that also clearly identifies the simulator's current limitations. The code and the model weights are released.

The design swaps construction for learning. A step at a time, fed only the trajectory the joints will follow, Uranus produces the views across cameras and embodiments, and it keeps going for as long as trajectories keep arriving. That is what makes it infrastructure rather than a demonstration. A simulator driven this way can sit underneath data generation, policy training and evaluation, the same jobs the problem began with.

Paper Quest · 7 chapters · about 41 min

Play this paper

Learn it by doing: make the calls the authors made, guess the result before you see it, and defend it in a viva graded on your own words. Chapter 1 is right here.

Chapter 1 🧩 · The problem

Robots need endless practice, and the real world is a slow, expensive teacher.

You need masses of robot experience: to generate data, train policies, evaluate them and iterate safely. Real-world interaction is costly, slow, hard to reproduce and limited by hardware and safety.

The road ahead

  1. 1 · The problem ~7 min Robots need huge amounts of practice, but real robots are costly and slow, and hand-built simulators take enormous effort and still differ from reality.
  2. 2 · What came before ~3 min
  3. 3 · The key idea ~9 min Uranus learns from recorded robot data to predict what the cameras will see next, given the robot's upcoming joint positions, and streams frames fast enough for interaction.
  4. 4 · Choose your own research ~3 min
  5. 5 · Build the method ~8 min Each step takes incoming joint positions, denoises one latent frame, decodes it into four RGB frames, and appends it to history before the next step.
  6. 6 · The experiment ~6 min You’ll guess: After inference optimization, how many frames per second can the Uranus robot simulator generate?
  7. 7 · The viva ~5 min Three questions from the examiners, answered in your own words. Win it for the paper’s trophy.
Join free to play the whole quest ›

Free, with Google or an email address. Your stars and progress are kept.

KipQuest: the day’s AI research, as podcasts and quests. All papers Android app Privacy Contact Episodes are written and voiced by AI from each paper. Summaries can contain mistakes: the paper is the source.