Systematically Exploring the Capabilities of GPT-6 Astra as Embodied Policies
Galbot Team, Xuchuan Chen, Xiaoqian Cheng, Yu Deng, Lihe Ding, Shaocong Dong, Xiangjun Gao, Haozhe Jia and 26 others
Galbot
Published September 29, 2026 · on the feed October 1, 2026 · ▲ 30 · arXiv 2609.38537
The abstract
GPT-6 Astra exhibits a remarkable ability to generate numerical robot actions, extending its role beyond high-level planning. To assess Astra's capabilities as general-purpose embodied policies, we conduct comprehensive evaluations across six domains, examining direct control, cooperation with learned policies, and feedback-driven adaptation. In gripper manipulation, Astra can correct task targets and prepare contact conditions for subsequent policy execution; hybrid control with π0.5 achieves 48% success on the evaluated RoboDojo subset. In dexterous manipulation, hybrid control achieves 50% success in ten experience-guided DexJoCo trials, while direct in-hand control struggles to coordinate finger contacts. In mobile manipulation, hybrid control reaches 38.7% success on the evaluated RoboCasa365. In navigation, Astra leads our local comparisons, reaching 92% success on RxR instruction following and 82% on HM3D object search, although search incurs substantial detours. In locomotion, dense motion-reference generation remains unreliable: none of five sequential attempts on a single obstacle course reaches the goal, despite improvements in stability and forward progress. In humanoid loco-manipulation, Astra exceeds baseline methods on 13 of 30 HumanoidBench tasks with pretrained whole-body controllers. These findings reveal a gap between useful task decisions and reliable physical control. Inference latency further constrains practical control: across 50 RoboDojo instances per condition, policy-assisted and direct control consume 624.8 million and 1.132 billion tokens. A 30-second locomotion run requires 250 model calls averaging 39.86 seconds each, with physics paused during inference.
The Brief
2:59A short podcast summary of the paper. Written and voiced by AI.
Transcript
Systematically Exploring the Capabilities of GPT-6 Astra as Embodied Policies. By Galbot Team and thirty-three others, from Galbot. Published on the twenty-ninth of September. Its code repository is worked out: about three hundred and fifty source files, with a readme and a licence.
GPT-6 Astra can generate numerical robot actions, which extends its role beyond high-level planning. The authors set out to test how far that goes, evaluating Astra as a general-purpose embodied policy across six domains. They look at three modes: direct control, cooperation with learned policies, and adaptation driven by feedback. Their conclusion is a gap. Astra is often good at deciding what should happen, and much less reliable at making it physically happen.
In gripper manipulation, Astra can correct task targets and set up contact conditions for a learned policy to execute afterwards. Hybrid control with the pi zero point five policy reaches forty-eight percent success on the evaluated RoboDojo subset. In dexterous manipulation, hybrid control succeeds in half of ten experience-guided DexJoCo trials, while direct in-hand control struggles to coordinate finger contacts. In mobile manipulation, hybrid control reaches thirty-eight point seven percent success on RoboCasa365.
Navigation is Astra's strongest domain in the authors' local comparisons: ninety-two percent success on RxR instruction following, and eighty-two percent on HM3D object search, though the searches take substantial detours. Locomotion is where it breaks down. Dense motion-reference generation is unreliable, and none of five sequential attempts on a single obstacle course reaches the goal, even though stability and forward progress improve. In humanoid loco-manipulation, with pretrained whole-body controllers, Astra beats the baseline methods on thirteen of the thirty HumanoidBench tasks.
Cost compounds the gap. Across fifty RoboDojo instances per condition, policy-assisted control consumes six hundred and twenty-four point eight million tokens. Direct control consumes one point one three two billion. A thirty-second locomotion run takes two hundred and fifty model calls, each averaging thirty-nine point eight six seconds, with the physics paused while the model thinks.
These are bounded results, and the abstract marks the bounds. Several numbers come from subsets: the evaluated part of RoboDojo, ten DexJoCo trials, a single obstacle course. The navigation lead is over the authors' own local comparisons, not a general ranking. The best manipulation numbers come from hybrid control, where a learned policy does part of the work. And the locomotion timing was measured with physics paused during every inference call, so the world waited for the model rather than the other way round.
Six domains, one recurring pattern. Where Astra decides, corrects targets, or follows instructions, it is useful. Where it must produce fine, continuous physical control on its own, it falters, and the time and tokens it spends per decision put a further limit on practical use.
Paper Quest · 7 chapters · about 36 min
Play this paper
Learn it by doing: make the calls the authors made, guess the result before you see it, and defend it in a viva graded on your own words. Chapter 1 is right here.
Chapter 1 🧩 · The problem
A model that writes robot actions makes for good demos. The real question is where it breaks.
A frontier reasoning model can now write numerical robot actions, not just high-level plans. People are posting impressive demos, from manipulation to 3D scene understanding.
The road ahead
- 1 · The problem ~6 min A reasoning model can now write numerical robot actions, but a few impressive demos cannot tell you what it reliably does as a controller.
- 2 · What came before ~3 min
- 3 · The key idea ~9 min Split control into two paths to see who does what, and the pattern is clear: good task decisions, unreliable fine physical control.
- 4 · Choose your own research ~3 min
- 5 · How it works ~3 min
- 6 · The experiment ~7 min You’ll guess: Generating dense motion references for a walking robot, how many of five sequential attempts at a single obstacle course reached the goal?
- 7 · The viva ~5 min Three questions from the examiners, answered in your own words. Win it for the paper’s trophy.
Free, with Google or an email address. Your stars and progress are kept.