ToolSpace: Scaling Tool-Centric Environment Synthesis for Long-Horizon Agents
Guanting Dong, Zhichao Sun, Xinyu Yang, Rui Wang, Xin Deng, Jiajie Jin, Zhixiong Yang, Junhao Huang and 17 others
Renmin University of China · Fudan University · Shanghai Jiao Tong University
Published November 3, 2026 · on the feed November 4, 2026 · ▲ 41 · arXiv 2611.05036
The abstract
Large language models are deployed as long-horizon agents that compose diverse tools across MCP services into executable workflows. Existing MCP environment-scaling methods are data-centric: they first synthesize a database and scenario, then derive tools and tasks from them. As a result, tool interfaces may not match real ones, tool compositions are not grounded in execution, and tasks rarely span more than one environment. We propose ToolSpace, a tool-centric framework that reverses this order. ToolSpace mines data, state, and retry dependencies from adjacent calls in execution traces of real MCP services and open agent corpora, using deterministic rules rather than LLM judgment, and clusters the resulting weighted tool-composition graph into environments. Databases are synthesized only for state-mutating environments, while query and stateless tools replay recorded returns. ToolSpace then performs state-aware random walks with rollback and decompiles each chain into a natural-language task with assertion-based checks, keeping only samples that replay successfully from the initial state. Applied to AutomationBench and tau3-Bench Banking, the pipeline produces harder Pro versions on which 7 frontier models drop by up to 38.2 points. Across seven long-horizon tool-use benchmarks, ToolSpace raises Qwen3.6-35B-A3B from 23.0 to 41.0 average score (43.2 with RL) and GLM-5.2 from 44.6 to 56.6, on par with Claude Opus 5. Ablations show that execution-witnessed edges clearly outperform LLM-judged ones, and performance keeps improving with data and environment scale.
The Brief
2:44A short podcast summary of the paper. Written and voiced by AI.
Transcript
ToolSpace. Scaling Tool-Centric Environment Synthesis for Long-Horizon Agents. By Guanting Dong and twenty-four others, from Renmin University of China, Fudan University, and one other institution. Published on the third of November.
Large language models now work as long-horizon agents, composing diverse tools across MCP services into executable workflows. Training them means scaling up MCP environments, and the existing methods for that are data-centric. They synthesize a database and a scenario first, then derive tools and tasks from those. The order has consequences, and the abstract names three. Tool interfaces may not match real ones, so an agent learns to call tools that do not behave like the ones it will meet. Tool compositions are not grounded in execution, so the chains it practises may never have actually run. And tasks rarely span more than one environment, even though the agents themselves compose tools across services.
ToolSpace reverses the order. It is tool-centric: start from how real tools are actually called together, and build environments around that. The dependencies come from execution traces of real MCP services and of open agent corpora, and they are mined with deterministic rules rather than with the judgment of an LLM. The database, which came first in the older recipe, now comes last, and only where it is needed.
From adjacent calls in those traces, ToolSpace extracts three kinds of dependency: data, state, and retry. The result is a weighted tool-composition graph, which is clustered into environments. Databases are synthesized only where an environment mutates state. Query tools and stateless tools simply replay recorded returns. Tasks then come from state-aware random walks over the graph, with rollback. Each walk yields a chain, which is decompiled into a natural-language task with assertion-based checks. A sample is kept only if it replays successfully from the initial state.
The pipeline was first applied to AutomationBench and to tau3-Bench Banking, producing harder Pro versions of each. On those, seven frontier models drop by as much as thirty-eight point two points.
As training data, it was measured across seven long-horizon tool-use benchmarks. Qwen3.6-35B-A3B rises from an average score of twenty-three to forty-one, and to forty-three point two once reinforcement learning is added. GLM-5.2 rises from forty-four point six to fifty-six point six, which puts it on par with Claude Opus 5. Ablations show that edges witnessed in execution clearly outperform edges judged by an LLM, and performance keeps improving as data and environment scale grow.
One choice runs through all of this: where the ground truth comes from. Instead of asking a model which tools belong together, ToolSpace looks at what real executions did, and keeps only tasks that can be replayed. The ablation on execution-witnessed edges is the direct test of that choice, and it comes out in its favour.
More with an account
Listen to every day’s papers
Daily playlists, deep dives, quests for the papers, and quizzes on their key terms.
Join free