Hard Vision, Easy Vision: What GPT-6 Astra Reveals Across Computer Vision
Hanoona Rasheed, Mohammed Irfan Kurpath, Bin Ren, Hisham Cholakkal, Fahad Shahbaz Khan, Salman Khan
Mohamed bin Zayed University of Artificial Intelligence · Apertix
Published September 28, 2026 · on the feed September 29, 2026 · ▲ 21 · arXiv 2609.35718
The abstract
Frontier general-purpose systems are rapidly expanding beyond visual understanding into capabilities traditionally handled by dedicated computer-vision models. As these capabilities expand, a central question for the computer-vision community is how far this reach extends, and what remains hard. We evaluate GPT-6 Astra alongside five frontier general-purpose AI systems across 34 capabilities and 55 benchmarks spanning nine areas of computer vision. We compare their performance with dedicated models and humans where suitable references are available. Astra demonstrates broad visual capability, with substantial gains over other frontier systems in visual and spatial reasoning and several forms of structured prediction. Across the state-of-the-art systems, a consistent pattern emerges. Capabilities involving semantic interpretation, reasoning, and object-centric prediction increasingly approach or reach available reference levels. In contrast, larger gaps remain when tasks require metric geometric accuracy, faithful reconstruction, temporally consistent dense prediction, or specialized fine-grained visual knowledge. Additional reasoning and specialist tools close selected gaps, but their benefits vary across capabilities. These results map a changing landscape of computer vision in which increasingly sophisticated visual tasks are accessible through a general-purpose interface, while precise and fidelity-sensitive perception remains an important frontier.
The Brief
2:38A short podcast summary of the paper. Written and voiced by AI.
Transcript
Hard Vision, Easy Vision. What GPT-6 Astra Reveals Across Computer Vision. By Hanoona Rasheed and five others, from the Mohamed bin Zayed University of Artificial Intelligence and Apertix. Published on the twenty-eighth of September. Its code repository is a placeholder: a readme, and nothing to run yet.
Frontier general-purpose systems are moving past visual understanding into capabilities that dedicated computer vision models have traditionally handled. The question this raises for the field is how far that reach extends, and what remains hard. The answer offered is a pattern. Tasks built on semantic interpretation, reasoning and object-centric prediction are increasingly approaching or reaching available reference levels. Tasks that demand metric geometric accuracy, faithful reconstruction, temporally consistent dense prediction, or specialized fine-grained visual knowledge still show larger gaps.
The evidence is a broad evaluation. GPT-6 Astra is tested alongside five other frontier general-purpose systems, across thirty-four capabilities and fifty-five benchmarks, spanning nine areas of computer vision. Their performance is compared with dedicated models, and with humans where suitable references exist. That breadth is the point of the design. A claim about what general systems can and cannot do in vision needs to be tested across the field, not on a handful of favourite tasks, and the reference points give each score something to be measured against beyond the other general systems.
Astra itself shows broad visual capability, with substantial gains over the other frontier systems in visual and spatial reasoning and in several forms of structured prediction. The split between easy and hard, though, is described as consistent across the state-of-the-art systems, not particular to one of them. Where a task asks what something is, or what follows from it, the systems are closing in. Where it asks exactly where something is, or for a faithful, dense and temporally stable reconstruction, they are not yet there.
Some of the gaps can be narrowed. Additional reasoning and specialist tools close selected ones, but their benefit varies from capability to capability, so neither is a general remedy. The comparisons are also bounded by what references are available: dedicated models and humans are used where suitable ones exist, which means not every capability is measured against both. And the picture is a snapshot of systems that the authors describe as rapidly changing.
The result is a map rather than a scoreboard. Increasingly sophisticated visual tasks are reachable through a general-purpose interface. Precise, fidelity-sensitive perception, the kind that has to get the geometry and the detail exactly right, remains the frontier.
Paper Quest · 7 chapters · about 36 min
Play this paper
Learn it by doing: make the calls the authors made, guess the result before you see it, and defend it in a viva graded on your own words. Chapter 1 is right here.
Chapter 1 🧩 · The problem
General AI is reaching into computer vision. The question is how far, and where it stops.
General-purpose AI systems now take on vision tasks once left to dedicated models: boxes, masks, depth maps, edited images. You want to know how far that reach really goes, and what is still hard.
The road ahead
- 1 · The problem ~7 min General AI systems now attempt many vision tasks once left to specialist models, but the evidence is too scattered to show how far that reach goes.
- 2 · What came before ~3 min
- 3 · The key idea ~9 min Test six general systems broadly against specialist and human references; meaning-based tasks are close, precise measuring and faithful reproducing still lag.
- 4 · Choose your own research ~3 min
- 5 · How it works ~3 min
- 6 · The experiment ~6 min You’ll guess: Across GPT-6 Astra and other frontier general-purpose systems, which kind of computer-vision task still showed the larger gaps to reference levels?
- 7 · The viva ~5 min Three questions from the examiners, answered in your own words. Win it for the paper’s trophy.
Free, with Google or an email address. Your stars and progress are kept.