OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learning

Xu Xu, Jinxiu Liu, Zhangbo Qiao, Jiaxing Lu, Xiangyu Zhang, Yubin Gu, Fangwei Ning, Yan Shi

Beihang University · The Chinese University of Hong Kong · National University of Singapore

Published September 13, 2026 · on the feed September 16, 2026 · ▲ 3 · arXiv 2609.16057

Vision & multimodalAgents Code arXiv ↗Hugging Face ↗

The abstract

Unified multimodal large language models (MLLMs) and multi-agent systems have advanced visual generation. However, three limitations remain. (1) Existing methods often distill task-specific experience with limited generalizability. (2) Reflection is often deferred until task completion. (3) Knowledge is often acquired only in response to downstream task demands. To address these limitations, we introduce OmniHarness, a framework for generalizable visual generation via symbolic policy learning. OmniHarness abstracts verified executions into symbolic policies for visual generation task families, capturing shared procedures and applicability conditions while removing instance-specific inputs. The harness instantiates, adapts, and composes these policies for new tasks. Intermediate verification guides refinement and failure recovery during execution. Through self-directed inquiry, OmniHarness autonomously generates and executes practice tasks near its capability limits before downstream objectives are specified. Execution feedback continually refines the policies while model parameters remain fixed. Experiments across six benchmarks, three MLLM backbones, and three visual agent frameworks demonstrate strong performance and continual capability expansion. On ComfyBench's Creative tasks, OmniHarness achieves a 95.0% resolve rate, exceeding the strongest baseline by 27.5 percentage points. Frozen policy snapshots improve existing visual agent systems through plug-and-play reuse.

The Brief

2:27

A short podcast summary of the paper. Written and voiced by AI.

Transcript

OmniHarness. Harnessing Generalizable Visual Generation via Symbolic Policy Learning. By Xu Xu and seven others, from Beihang University, the Chinese University of Hong Kong, and one other institution. Published on the thirteenth of September. Its code repository is public and real: about twenty source files.

Unified multimodal large language models, and multi-agent systems built on them, have pushed visual generation forward. Three limitations remain. First, existing methods often distill experience that is specific to one task, and it generalizes poorly. Second, reflection is usually deferred until a task is complete, so a mistake early on is only noticed at the end. Third, knowledge is typically acquired only in response to what a downstream task demands. The system learns when asked, and not before.

OmniHarness is a framework for generalizable visual generation through symbolic policy learning. Verified executions are abstracted into symbolic policies for families of visual generation tasks. A policy captures the shared procedure, together with the conditions under which it applies, and removes the inputs specific to any one instance. It is a recipe rather than a record of one meal. The harness then instantiates, adapts and composes these policies for new tasks.

Each of the three limitations gets a direct answer. Against narrow experience, the policies are abstracted to cover a task family. Against late reflection, intermediate verification guides refinement and failure recovery during execution, not after it. Against reactive learning, self-directed inquiry has OmniHarness generate and run its own practice tasks near the limits of its capability, before any downstream objective is specified. Throughout, execution feedback keeps refining the policies while the model parameters stay fixed.

Experiments span six benchmarks, three MLLM backbones, and three visual agent frameworks, and show strong performance along with continual expansion of capability. On ComfyBench's Creative tasks, OmniHarness reaches a ninety-five percent resolve rate, twenty-seven point five percentage points above the strongest baseline. Frozen snapshots of the policies also improve existing visual agent systems through plug-and-play reuse. The policies, in other words, are portable. They carry what was learned into systems that never did the learning.

Learning here lives in the policies, not in the weights. That is what allows practice to happen before any task arrives, and what lets a frozen snapshot be lifted out of one system and dropped into another.

Paper Quest · 7 chapters · about 40 min

Play this paper

Learn it by doing: make the calls the authors made, guess the result before you see it, and defend it in a viva graded on your own words. Chapter 1 is right here.

Chapter 1 🧩 · The problem

Saved successes that don't transfer, errors found too late. Start there.

You run a team of model-driven agents that build image workflows. When a task succeeds, you save the run, but a saved run solves only that one case and transfers poorly to the next task.

The road ahead

  1. 1 · The problem ~6 min Agents that build image workflows keep single saved runs, check their work only at the end, and learn only when a real task forces them.
  2. 2 · What came before ~3 min
  3. 3 · The key idea ~9 min Keep recipes, not records: abstract verified runs into symbolic policies, check each step mid-run, and practise on self-made tasks while weights stay fixed.
  4. 4 · Choose your own research ~3 min
  5. 5 · Build the method ~8 min A loop: propose practice tasks at the edge, run them by composing policies with mid-run checks, then distil successes and record failures to refine the library.
  6. 6 · The experiment ~6 min You’ll guess: On ComfyBench's Creative tasks, by how many percentage points did OmniHarness's resolve rate exceed the strongest baseline?
  7. 7 · The viva ~5 min Three questions from the examiners, answered in your own words. Win it for the paper’s trophy.
Join free to play the whole quest ›

Free, with Google or an email address. Your stars and progress are kept.

KipQuest: the day’s AI research, as podcasts and quests. All papers Android app Privacy Contact Episodes are written and voiced by AI from each paper. Summaries can contain mistakes: the paper is the source.