PrismaCoder: Pushing the Boundaries of Open Multimodal Code Intelligence through Decomposed Rubric Synthesis

Qiushi Sun, Jingyang Gong, Yang Liu, Qiaosheng Chen, Zhangyue Yin, Zixian Huang, Hanxu Hu, Jing Xiong and 9 others

The University of Hong Kong · Nanjing University · Fudan University · Huawei · University of Zurich · Shanghai Innovation Institute

Published October 14, 2026 · on the feed October 22, 2026 · ▲ 72 · arXiv 2610.20538

Vision & multimodalEvaluation & judgingCode & software Full code arXiv ↗Hugging Face ↗Weights ↗Dataset ↗

The abstract

Multimodal code intelligence connects the symbolic world of programs with the visual world their execution creates. Interest in this capability is burgeoning, as models are increasingly asked to produce charts, webpages, animations, and semi-structured documents. Recently, proprietary models have pushed far ahead, producing interactive artifacts even from a text description or a screenshot alone. Yet their data and training remain closed, and open progress is held back by the quantity and quality of available data and by the pipelines and methods for producing it. Quality is the harder of the two, since a sample must be correct as a program, well built, and above all visually right once rendered. No existing signal covers all three. Execution often returns just a pass or fail, code similarity does not map to the visual output, and task-specific verifiers do not generalize. To push open progress further, we start from the data side with PrismaForge, a hierarchical data pipeline centered on a synthesized rubric that decomposes these factors into checkable criteria. The same rubric serves as both filter and reward: it curates the supervised corpus, then drives reinforcement learning on visual-coding tasks. Leveraging PrismaForge for data synthesis and filtering, we build PrismaCoder-2M, the most diverse open dataset for multimodal code intelligence and the largest to date. On the model side, we train PrismaCoder-9B and PrismaCoder-35B on this data and release both. They lead the open state of the art by a wide margin and rival leading proprietary systems. Our analyses further show that the proposed rubric-based pipeline improves multimodal coding performance across model backbones. We release our code and data at https://qiushisun.github.io/PrismaCoder-Home/.

The Brief

2:52

A short podcast summary of the paper. Written and voiced by AI.

Transcript

PrismaCoder. Pushing the Boundaries of Open Multimodal Code Intelligence through Decomposed Rubric Synthesis. By Qiushi Sun and sixteen others, from the University of Hong Kong, Nanjing University, and four other institutions. Published on the fourteenth of October. Its code repository is worked out: about one hundred and ten source files, with a readme.

Multimodal code intelligence is the meeting point of two worlds: the symbolic world of programs, and the visual world that running them creates. Interest in it is growing quickly, because models are increasingly asked to produce charts, webpages, animations and semi-structured documents. Proprietary models have pushed far ahead here, producing interactive artifacts from nothing more than a text description or a screenshot. Their data and their training, however, remain closed.

This release answers that from the open side. It has three parts. A dataset, PrismaCoder-2M, which the authors describe as the most diverse open dataset for multimodal code intelligence and the largest to date. Two trained models, PrismaCoder-9B and PrismaCoder-35B, both released. And the code and data behind them, published alongside.

The dataset targets visual coding: programs judged partly by what they look like once rendered. The models are trained on it, and the quality signal that shaped the corpus returns in reinforcement learning on visual-coding tasks.

That notion is the heart of the work. The authors observe that open progress is held back both by how much data exists and by how good it is, along with the pipelines and methods for producing it. Quality is the harder problem. A sample has to be correct as a program, well built, and above all visually right once rendered. No existing signal covers all three. Execution often returns just a pass or a fail. Code similarity does not map to the visual output. Task-specific verifiers do not generalize.

Their answer is PrismaForge, a hierarchical data pipeline centred on a synthesized rubric. The rubric decomposes those quality factors into criteria that can each be checked. It then serves two roles. As a filter, it curates the supervised training corpus. As a reward, it drives the reinforcement learning stage. PrismaCoder-2M is the result of using PrismaForge for both data synthesis and filtering, and the authors' analyses indicate that the rubric-based pipeline improves multimodal coding performance across different model backbones, not only the ones released here.

Anyone building open models that write code with a visual result now has a large corpus and two checkpoints to start from. The authors report that both models lead the open state of the art by a wide margin and rival leading proprietary systems.

The problem this release takes on is knowing what good data looks like when correctness is partly visual. One rubric, broken into checkable pieces, decides what enters the corpus and then rewards the model in training, and that single source of judgement ties the dataset and both models together.

More with an account

Listen to every day’s papers

Daily playlists, deep dives, quests for the papers, and quizzes on their key terms.

Join free
KipQuest: the day’s AI research, as podcasts and quests. All papers Android app Privacy Contact Episodes are written and voiced by AI from each paper. Summaries can contain mistakes: the paper is the source.