VIEScore2: Unified Image Evaluation with Spatially Grounded Explanations
Xianda Du, Max Ku, Weiming Ren, Zhi Rui Tam, Chunlin Ren, Ping Nie, Min-Hung Chen, Wenhu Chen
University of Waterloo · NVIDIA · National Taiwan University · Nanyang Technological University
Published October 1, 2026 · on the feed October 8, 2026 · ▲ 26 · arXiv 2610.00994
The abstract
Existing synthetic image evaluators typically provide only a scalar quality score and do not identify the image regions that support it. We introduce VIEScore2, a unified evaluator for image generation and editing tasks with optional conditioning images. VIEScore2 represents an image as an N x N grid and jointly predicts quality scores and defect locations in a single model pass. Its text-native grid representation provides a common interface for heterogeneous spatial supervision and enables directly verifiable post-training objectives. We train on 38K examples spanning score-only, localization-only, and joint supervision across generation and editing tasks. Starting from supervised fine-tuning, we further apply GRPO to improve defect localization using rewards that combine cell-level Dice overlap, score accuracy, and output-format validity. A parameter-free parser converts the structured predictions into readable explanations. On the primary suite, VIEScore2 achieves an overall-score SRCC of 0.601, compared with 0.491 for Gemini-3-Flash, the strongest zero-shot general-purpose VLM baseline under matched inputs. For defect localization, VIEScore2 outperforms both general-purpose VLMs and specialized spatial evaluators on three of six benchmarks in per-image grid IoU and ranks among the top three on five, including datasets beyond its training sources.
The Brief
2:36A short podcast summary of the paper. Written and voiced by AI.
Transcript
VIEScore2. Unified Image Evaluation with Spatially Grounded Explanations. By Xianda Du and seven others, from the University of Waterloo, NVIDIA, and two other institutions. Published on the first of October. Its code repository is worked out: about fifty-five source files, with a readme and a licence.
Existing evaluators of synthetic images typically return a single scalar quality score, and do not identify the regions of the image that support it. The number says how good an image is without saying where it fell short. A score of that kind can rank images, but it cannot point at the part of an image that brought the score down, and so it cannot explain itself.
VIEScore2 is one evaluator for both image generation and image editing, with optional conditioning images. Unified here means one model covering both tasks, with or without an image to condition on. It represents an image as an N by N grid and, in a single model pass, jointly predicts quality scores and the locations of defects. Because the grid representation is native to text, it gives heterogeneous kinds of spatial supervision a common interface, and it makes post-training objectives directly verifiable.
Training uses thirty-eight thousand examples. Some carry scores only, some localization only, and some both, across generation and editing tasks. After supervised fine-tuning, GRPO is applied to improve defect localization, with rewards that combine cell-level Dice overlap, score accuracy, and the validity of the output format. The text-native grid is what makes those rewards checkable. Predicted cells can be compared with the true defect cells directly, which is what the Dice overlap measures, alongside whether the score is right and whether the output can be parsed at all. A parameter-free parser then turns the structured predictions into readable explanations.
On the primary suite, VIEScore2 reaches an overall-score SRCC of zero point six zero one. The strongest zero-shot general-purpose VLM baseline under matched inputs, Gemini-3-Flash, reaches zero point four nine one. For defect localization, measured by per-image grid IoU, VIEScore2 outperforms both general-purpose VLMs and specialized spatial evaluators on three of six benchmarks, and ranks among the top three on five of them, including datasets beyond its training sources. Two abilities are measured separately here, scoring and localizing, and on the second the comparison includes evaluators built specifically for spatial judgments.
The grid holds the design together. Writing location as text lets one model score and point in the same pass, lets different kinds of labels train it, lets a reward check its answers cell by cell, and lets a plain parser explain them.
More with an account
Listen to every day’s papers
Daily playlists, deep dives, quests for the papers, and quizzes on their key terms.
Join free