Qwen-Planner-Agent: A Closed-Loop AI-for-AI Framework for Real-World Mobile Planner Agents
Tingyu Qu, Weigao Sun, Yuecheng Liu, Yucheng Zhao, Yi Zhu, Yifeng Ding, Qiyi Wang, Sihan Cao and 18 others
Alibaba Token Hub, Alibaba Group
Published September 24, 2026 · on the feed September 25, 2026 · ▲ 18 · arXiv 2609.29892
The abstract
The rapid progression of large language models is extending AI from passive content generation into the active workflows of engineering and scientific discovery. This shift raises a compelling question: can AI be both the object of development and an active participant in building next-generation AI systems? We explore this question by building Qwen-Planner-Agent within a closed-loop AI-for-AI framework for scalable development and iterative improvement. Mobile planning offers a demanding test of this approach: complex, long-horizon tasks challenge agent reliability, while costly real-device interaction limits development scalability. The framework connects data production, model training, and deployment through a shared action-feedback-verification contract. (i) AI for Data builds a human-gated agentic data flywheel in which specialized agents construct tasks, collect interaction trajectories, curate and balance training data, and use training feedback to guide subsequent data generation. (ii) AI for Training combines a supervised planning cold start with hybrid-environment online agentic reinforcement learning, where we introduce Competence-Aware Reward-and-Advantage Engineering (CARE) to reduce reasoning and tool-use costs while preserving task performance. (iii) AI drives model--harness co-evolution through an execution-evidence-driven loop that orchestrates memory, skills, and tools at runtime and feeds structured action feedback and preserved failure traces back into coordinated model and harness adaptation. Qwen-Planner-Agent achieves the best overall performance among all evaluated models and systems on MobilePA-Bench, improving over its base model across tool use, memory, skills, and sub-agent coordination. Further evaluations of our model show improvements across non-mobile agentic benchmarks while largely preserving general capabilities.
The Brief
2:53A short podcast summary of the paper. Written and voiced by AI.
Transcript
Qwen-Planner-Agent. A Closed-Loop AI-for-AI Framework for Real-World Mobile Planner Agents. By Tingyu Qu and twenty-five others, from Alibaba Token Hub, Alibaba Group. Published on the twenty-fourth of September. No code repository is linked to it.
AI is moving out of passive content generation and into the active workflows of engineering and scientific discovery, carried by fast progress in large language models. That raises a question the authors put directly: can AI be both the thing being developed and an active participant in building the next generation of AI systems? To test it they need a demanding target, and they choose mobile planning. It is demanding on two fronts. The tasks are complex and long-horizon, which strains an agent's reliability. And interacting with real devices is costly, which limits how far development can scale.
Qwen-Planner-Agent is built inside a closed-loop, AI-for-AI framework meant for scalable development and iterative improvement. The framework ties together three stages into one loop: producing data, training the model, and deploying it. What binds them is a shared contract of action, feedback, and verification, so that each stage speaks the same language to the others. Each stage then has AI doing the work.
The first stage is AI for Data. It is a human-gated agentic data flywheel, in which specialized agents construct tasks, collect interaction trajectories, curate and balance the training data, and use feedback from training to guide what data gets generated next.
The second is AI for Training. A supervised planning cold start is followed by online agentic reinforcement learning in a hybrid environment. Here the authors introduce Competence-Aware Reward-and-Advantage Engineering, or CARE, whose purpose is to cut the cost of reasoning and tool use while preserving task performance. The third stage is where the model and its harness co-evolve. An execution-evidence-driven loop orchestrates memory, skills, and tools at runtime, and feeds structured action feedback and preserved failure traces back into adapting the model and the harness together, in coordination.
On MobilePA-Bench, Qwen-Planner-Agent achieves the best overall performance among all the models and systems evaluated. It improves over its own base model across four areas: tool use, memory, skills, and coordination between sub-agents. The gains are not confined to mobile. Further evaluations show improvements on agentic benchmarks outside the mobile setting, while general capabilities are largely preserved.
The framework answers its opening question with a working system rather than an argument. Agents build the tasks and curate the data. Training feedback steers the next round of data. Runtime failures are kept and sent back to reshape both the model and the harness around it. At every stage, AI is both the thing being improved and one of the hands doing the improving, and the contract of action, feedback, and verification is what lets those stages hand work to one another.
Paper Quest · 7 chapters · about 39 min
Play this paper
Learn it by doing: make the calls the authors made, guess the result before you see it, and defend it in a viva graded on your own words. Chapter 1 is right here.
Chapter 1 🧩 · The problem
A phone, a long goal, and every real test costs money. Start there.
You are building an assistant that completes long, multi-step goals on a phone: coordinating actions across apps, tracking state as it changes, recovering from failures, and checking the goal was really reached.
The road ahead
- 1 · The problem ~6 min A phone assistant must finish long multi-step goals, but every real-device test is slow and costly, so improving it at scale is hard.
- 2 · What came before ~3 min
- 3 · The key idea ~8 min AI helps build the agent at every stage, the stages share one record format, and failures flow back to improve model and harness together.
- 4 · Choose your own research ~3 min
- 5 · Build the method ~8 min Agents build tasks and collect runs, a supervised cold start teaches planning, online RL refines it, and failure traces revise model and harness.
- 6 · The experiment ~6 min You’ll guess: On MobilePA-Bench, how did Qwen-Planner-Agent compare with all the other models and agent systems it was evaluated against?
- 7 · The viva ~5 min Three questions from the examiners, answered in your own words. Win it for the paper’s trophy.
Free, with Google or an email address. Your stars and progress are kept.