SCOPE: Semantic Bounded Credit Optimization for Prompt Engineering in Text-to-image Generation
Yufei Jiao, Jinfa Huang, Zeyue Xue, Tianyu Xie, Yuexiao Ma, Rongrong Ji, Xiawu Zheng, Jiebo Luo
Xiamen University · University of Rochester · Nanyang Technological University · The University of Hong Kong
Published October 15, 2026 · on the feed October 16, 2026 · ▲ 76 · arXiv 2610.22264
The abstract
Reinforcement learning (RL) enables language models to improve text-to-image (T2I) generation by rewriting prompts for a frozen image generator. Existing methods typically apply a single signal derived from the image to individual subword tokens, although objects, counts, attributes, and relations form coherent semantic spans. We propose SCOPE, an objective based on Group Relative Policy Optimization (GRPO) that aligns update weighting with this structure. The rewriter jointly generates an enhanced prompt and its semantic partition. SCOPE pools shifts in policy log probabilities within each span to derive a shared coefficient for its token losses while retaining a single advantage for each completion. It requires neither separate span rewards nor additional image renders. Across Qwen-Image, SD3, and FLUX.1-dev, SCOPE achieves average relative gains over vanilla GRPO of 9.48% on GeneVal and 7.62% on T2I-CompBench. Ablation studies show that both semantic boundaries and pooling within spans contribute to these gains, supporting semantic structure as a practical inductive bias for prompt engineering with RL.
The Brief
2:07A short podcast summary of the paper. Written and voiced by AI.
Transcript
SCOPE. Semantic Bounded Credit Optimization for Prompt Engineering in Text-to-image Generation. By Yufei Jiao and seven others, from Xiamen University, the University of Rochester, and two other institutions. Published on the fifteenth of October. Its code repository is worked out: about one hundred and ninety source files, with a readme.
Reinforcement learning lets a language model improve text-to-image generation without touching the image generator at all: the model learns to rewrite prompts for a generator that stays frozen. Existing methods take a single signal derived from the resulting image and apply it to individual subword tokens. Yet the content of a prompt is not organised by subword. Objects, counts, attributes, and relations each form a coherent semantic span. Credit is being handed out at a finer grain than the meaning it is meant to reward.
SCOPE is an objective built on Group Relative Policy Optimization that aligns how updates are weighted with that structure. The rewriter generates two things together: an enhanced prompt, and a semantic partition of that prompt into spans.
Within each span, SCOPE pools the shifts in policy log probabilities to derive one shared coefficient for that span's token losses. Each completion still keeps a single advantage, so the reward signal itself is unchanged. It requires no separate reward for each span, and no additional image renders. What changes is only how the existing signal is spread across tokens.
The rewriter was tested with three generators: Qwen-Image, SD3, and FLUX.1-dev. Averaged across them, SCOPE improves on vanilla GRPO by a relative nine point four eight percent on GeneVal and seven point six two percent on T2I-CompBench. Ablation studies show that both pieces matter: the semantic boundaries, and the pooling within spans, each contribute to those gains.
The change is narrow on purpose. Reward stays as it was, rendering stays as it was, and only the weighting of token updates now follows units of meaning rather than subword pieces. The authors present semantic structure as a practical inductive bias for prompt engineering with reinforcement learning, one that costs nothing extra at the image generator.
More with an account
Listen to every day’s papers
Daily playlists, deep dives, quests for the papers, and quizzes on their key terms.
Join free