MJev-Spatial: System One Spatial Intelligence via Native Attention Matching
Luozheng Qin, Yuhan Zhu, Changhai Zhou, Qian Qiao, Jun Gao, Yuhua Zhou, Harry Zhang, Xiangyu Zeng and 4 others
Mind Lab
Published October 15, 2026 · on the feed October 16, 2026 · ▲ 545 · arXiv 2610.22276
The abstract
Spatial intelligence lets an agent perceive and act in the physical world, and many of its judgments must be made at interaction rates: which spatial relation holds, how far an object is, or where to place it. Vision-language models (VLMs) produce these answers by free-form text generation, paying for autoregressive decoding and answer parsing even though the output space is compact: one of a few options, a scalar, or a 2D point. In light of this, we introduce MJev-Spatial, a System 1 multimodal decision model that tackles all three types of spatial understanding tasks within a unified classification framework. Specifically, MJev-Spatial treats each candidate as a class and scores it using the backbone's pretrained query and key projections, without adding parameters. The candidates are the given options for choice tasks, or value bins and image regions refined through coarse-to-fine classification for numerical and point prediction, respectively. At inference, each classification decision takes a single forward pass and generates no answer tokens. To train on heterogeneous spatial data efficiently, we supervise all coarse-to-fine stages jointly with teacher forcing in one forward pass, and combine this with length-aware global batching and cross-GPU load balancing, raising training throughput by 30.8% over the original batching strategy. Built on Qwen3.5-4B and trained on 12.3M question-answer pairs converted from existing spatial datasets, MJev-Spatial achieves the highest overall score (65.64%) among eight tested models, ranks first on seven of twelve benchmarks, and outperforms its unmodified autoregressive base model on all twelve, while running 2.5 times faster than the fastest autoregressive baseline and 5.6 times faster than the base model.
The Brief
2:58A short podcast summary of the paper. Written and voiced by AI.
Transcript
MJev-Spatial. System One Spatial Intelligence via Native Attention Matching. By Luozheng Qin and eleven others, from Mind Lab. Published on the fifteenth of October. Its code repository is public and real: nineteen source files.
Spatial intelligence is what lets an agent perceive and act in the physical world, and many of its judgments have to be made at interaction rates. Which spatial relation holds. How far away an object is. Where to place something. Vision-language models answer questions like these by free-form text generation. That means paying for autoregressive decoding, and then for parsing an answer out of the text, even though the space of possible outputs is compact: one of a few options, a single scalar, or a point in two dimensions. The cost of the answer is set by the generation process, not by the size of what is being decided.
MJev-Spatial is a System One multimodal decision model. It handles all three kinds of spatial understanding task inside a single classification framework, where each candidate answer is treated as a class. The candidates are scored with the backbone's own pretrained query and key projections, so no parameters are added. What counts as a candidate depends on the task. For choice tasks, the candidates are the given options. For numerical prediction they are value bins, and for point prediction they are image regions, both refined through coarse-to-fine classification.
At inference, each classification decision takes a single forward pass and generates no answer tokens. Training raises its own efficiency problem, because the spatial data is heterogeneous. All of the coarse-to-fine stages are supervised jointly, with teacher forcing, in one forward pass. That is combined with length-aware global batching and cross-GPU load balancing, which together raise training throughput by thirty point eight percent over the original batching strategy.
The model is built on Qwen3.5-4B and trained on twelve point three million question-answer pairs, converted from existing spatial datasets. Among eight tested models it achieves the highest overall score, sixty-five point six four percent, and it ranks first on seven of the twelve benchmarks.
Against its own unmodified autoregressive base model, it comes out ahead on all twelve. It is also faster. It runs two point five times faster than the fastest autoregressive baseline, and five point six times faster than the base model it started from. Accuracy and speed improve together rather than being traded against each other.
The argument rests on a mismatch between the question and the machinery. When an answer is one of a few options, a number, or a point, generating text to express it spends decoding on something a single scoring pass can deliver. MJev-Spatial recasts every such answer as a choice among candidates, scores those candidates with attention projections the backbone already has, and in the reported results ends up both more accurate and faster than the model it began as. The phrase System One in the title names that ambition: quick, direct judgments, made at the pace an agent acting in the world requires.
Paper Quest · 7 chapters · about 39 min
Play this paper
Learn it by doing: make the calls the authors made, guess the result before you see it, and defend it in a viva graded on your own words. Chapter 1 is right here.
Chapter 1 🧩 · The problem
Every quest starts with a wall. Here it is a model that writes essays to answer with a single point.
You are building a robot's spatial sense. It must judge which relation holds, how far an object is, or where to place something, at interaction rates.
The road ahead
- 1 · The problem ~6 min Spatial questions have tiny answers, yet vision-language models spend time writing and parsing whole text replies to give them.
- 2 · What came before ~3 min
- 3 · The key idea ~8 min Turn every spatial answer into a small set of classes and score them with the model's own attention projections, refining numbers and points coarse-to-fine.
- 4 · Choose your own research ~3 min
- 5 · Build the method ~8 min Make each answer a class, score classes with the final layer's pretrained query and key projections, then subdivide chosen bins or regions and score again.
- 6 · The experiment ~6 min You’ll guess: How much faster did MJev-Spatial run than its own unmodified autoregressive base model?
- 7 · The viva ~5 min Three questions from the examiners, answered in your own words. Win it for the paper’s trophy.
Free, with Google or an email address. Your stars and progress are kept.