MMVistaReason: Toward Open-Data and Post-Training Recipes for Multimodal Reasoning

Juekai Lin, Honglin Lin, Yuqian Yuan, Xiaolong Wu, Jie Cao, Liang Liang, Yunqi Cao, Yun Zhu and 2 others

Zhejiang University · Ant Group · Shanghai Jiao Tong University · Tongji University

Published October 22, 2026 · on the feed October 26, 2026 · ▲ 16 · arXiv 2610.01352

LLM training & RLVision & multimodalReasoning & math Code arXiv ↗Hugging Face ↗

The abstract

Open multimodal reasoning models have benefited from large-scale reasoning supervision, yet reliable post-training remains challenging due to uneven data quality, inefficient supervision construction, imbalanced difficulty, and cross-domain interference. We introduce MMVistaReason (MVR), an open-data post-training recipe with three components: (1) broader capability coverage across complementary Analytical and Real-World reasoning groups, emphasizing structured reasoning versus visual perception and spatial grounding; (2) efficient SFT and RL data construction, standardizing heterogeneous open data through staged cleaning and annotation, combining difficulty-aware cascaded teacher distillation with answer-likelihood-based trajectory selection to construct MVR-SFT-528K, and applying scale-specific frontier filtering for MVR-RL-63K; and (3) specialize-then-integrate training, which trains complementary RL experts and consolidates their capabilities through multi-teacher on-policy distillation (MOPD). Our analyses reveal a capacity-dependent interaction between supervision difficulty, trajectory quality, and model capacity: smaller students benefit more from selected supervision, while larger students are robust to trajectory variation and mixed-domain interference. Mixed-domain RL introduces benchmark-level negative transfer, whereas MOPD provides consistent capability integration, with the preferred KL direction varying across model scales. Across 15 multimodal benchmarks, MVR-4B achieves an average score of 72.8, outperforming Qwen3.5-9B (Instruct) and MMFineReason-8B while using about 70% fewer samples than MMFineReason. Scaling to 9B improves the average to 74.4, surpassing Qwen3.5-35B-A3B (Instruct). Overall, MMVistaReason demonstrates that systematic open-data construction and capacity-aware post-training provide a practical and scalable path toward reliable multimodal reasoning.

The Brief

2:58

A short podcast summary of the paper. Written and voiced by AI.

Transcript

MMVistaReason. Toward Open-Data and Post-Training Recipes for Multimodal Reasoning. By Juekai Lin and nine others, from Zhejiang University, Ant Group, and two other institutions. Published on the twenty-second of October. Its code repository is public and real: about fifty source files.

Open multimodal reasoning models have been helped along by large-scale reasoning supervision. Post-training them reliably is another matter, and the authors name four reasons it stays hard. Open data is uneven in quality. Building supervision from it is inefficient. Difficulty is imbalanced across examples. And training on several domains at once lets them interfere with one another. None of these is about the model being too small. They are about what goes into it and in what order.

MMVistaReason, shortened to MVR, is an open-data post-training recipe built to meet those four problems with three components. The first is coverage. It splits capability into two complementary groups: Analytical reasoning, which leans on structured reasoning, and Real-World reasoning, which leans on visual perception and spatial grounding. The second is efficient data construction for both supervised fine-tuning and reinforcement learning. The third is a training order the authors call specialize-then-integrate.

On the data side, heterogeneous open data is standardized through staged cleaning and annotation. Supervised data is then built by combining difficulty-aware cascaded teacher distillation with trajectory selection based on answer likelihood, which yields MVR-SFT-528K. For reinforcement learning, a scale-specific frontier filter produces MVR-RL-63K.

On the training side, rather than mixing every domain into one run, complementary RL experts are trained separately. Their capabilities are then consolidated into one model through multi-teacher on-policy distillation, called MOPD.

The analyses find that supervision difficulty, trajectory quality and model capacity interact, and that the interaction depends on capacity. Smaller students gain more from carefully selected supervision. Larger students are robust both to variation in trajectories and to mixed-domain interference. Mixed-domain RL produced negative transfer at the level of individual benchmarks, while MOPD integrated capabilities consistently, though which KL direction worked best changed with model scale.

Across fifteen multimodal benchmarks, MVR-4B averages seventy-two point eight. That puts it ahead of Qwen3.5-9B in its Instruct version and of MMFineReason-8B, while using about seventy percent fewer samples than MMFineReason. Scaling up to nine billion parameters lifts the average to seventy-four point four, which surpasses Qwen3.5-35B-A3B, also Instruct.

What this recipe asks of anyone copying it is a decision per model size. A small student wants its supervision filtered hard, a large one can absorb messier trajectories, and even the preferred KL direction in MOPD is a per-scale setting. The authors read that as a practical and scalable path to reliable multimodal reasoning built entirely on open data, provided the post-training is tuned to the capacity of the model receiving it.

More with an account

Listen to every day’s papers

Daily playlists, deep dives, quests for the papers, and quizzes on their key terms.

Join free
KipQuest: the day’s AI research, as podcasts and quests. All papers Android app Privacy Contact Episodes are written and voiced by AI from each paper. Summaries can contain mistakes: the paper is the source.