TailSteer: Trajectory-Tail Steering for Drift-Resistant Multi-turn Image Editing

Ruikang Li, Zixuan Chen, Jiarui Wu, Mingde Yao, Yiyuan Zhang, Yujin Wang, Hanming Deng, Lewei Lu and 1 others

CUHK · SenseTime Research · Shanghai Artificial Intelligence Laboratory

Published November 4, 2026 · on the feed November 6, 2026 · ▲ 43 · arXiv 2611.06741

Image generation & editingLLM training & RLVision & multimodal Full code arXiv ↗Hugging Face ↗

The abstract

Strong single-turn editing performance does not guarantee reliable multi-turn interaction: as edited outputs are repeatedly reused, small unintended changes can accumulate into severe visual drift. This long-term drift is often mitigated through training on multi-turn data or cross-turn rollouts, potentially altering pretrained priors, or through specialized inference-time mechanisms that are difficult to scale to foundation models. We introduce TailSteer, a final-stage training framework that improves multi-turn robustness while retaining the generative and editing capabilities acquired through earlier training. TailSteer follows a simple principle: keep early denoising dynamics close to those of the base model and concentrate preservation corrections near the trajectory tail, where fine-grained deviations can be suppressed. These corrections are learned from the editor's own on-policy denoising rollouts, using unchanged source content as a preservation reference without requiring curated ground-truth editing pairs. Experiments across the FLUX, SenseNova, and Qwen families show that TailSteer substantially reduces cumulative drift over 15-20 editing turns while largely preserving base-model performance on extensive text-to-image and single-image editing benchmarks. These results demonstrate that long-horizon editing robustness can be unlocked in foundation models after TailSteer, rather than by relearning their existing capabilities.

The Brief

2:24

A short podcast summary of the paper. Written and voiced by AI.

Transcript

TailSteer. Trajectory-Tail Steering for Drift-Resistant Multi-turn Image Editing. By Ruikang Li and eight others, from the Chinese University of Hong Kong, SenseTime Research, and one other institution. Published on the fourth of November.

An image editor can be excellent at a single edit and still fall apart over a conversation. In multi-turn editing, each output becomes the input to the next request, and the same image is reused again and again. Small unintended changes that nobody would notice once begin to pile up, and after enough turns they accumulate into severe visual drift. Strong single-turn performance, in other words, does not guarantee reliable multi-turn interaction.

The usual remedies each carry a cost. One is to train on multi-turn data or on cross-turn rollouts, which can alter the pretrained priors the editor already has. The other is a specialized inference-time mechanism, and those are difficult to scale to foundation models.

TailSteer is offered as a final-stage training framework: something applied at the end, meant to improve multi-turn robustness while keeping the generative and editing capabilities earned in earlier training. Its principle is simple. Leave the early part of denoising alone, keeping its dynamics close to those of the base model, and concentrate preservation corrections near the tail of the trajectory. The tail is where fine-grained deviations can be suppressed, and fine-grained deviations are exactly what compounds into drift.

The corrections are learned from the editor's own on-policy denoising rollouts. Rather than relying on curated ground-truth editing pairs, which TailSteer does not require, it uses the unchanged source content as a preservation reference. Whatever part of the image an edit was not supposed to touch serves as the target to hold onto. Because the early dynamics stay near the base model, the broad behaviour of the editor is left in place, and the training effort is spent at the end of the trajectory.

Experiments span three model families: FLUX, SenseNova, and Qwen. Across them, TailSteer substantially reduces cumulative drift over fifteen to twenty editing turns. At the same time, the base models largely keep their performance on extensive text-to-image benchmarks and single-image editing benchmarks, which is the other half of the claim. A fix for drift that cost the editor its original skill would not count.

The authors read these results as showing that long-horizon editing robustness can be unlocked in a foundation model after the fact, with TailSteer, rather than by relearning capabilities the model already had. The design choice carrying that argument is where the correction lives: at the tail of the trajectory, not spread through all of it.

Paper Quest · 7 chapters · about 40 min

Play this paper

Learn it by doing: make the calls the authors made, guess the result before you see it, and defend it in a viva graded on your own words. Chapter 1 is right here.

Chapter 1 🧩 · The problem

One edit is easy. The twentieth edit of the same picture is where things fall apart.

You run an image editor that is excellent at a single edit. Users now chat with it, asking for one change after another, and each output becomes the next input.

The road ahead

  1. 1 · The problem ~6 min An editor that is great at one edit can slowly ruin an image over a long chat, because each edit's small slips are inherited.
  2. 2 · What came before ~3 min
  3. 3 · The key idea ~9 min Train the early denoising steps to match the base model, and steer only the final steps to hold unchanged content to the source image.
  4. 4 · Choose your own research ~3 min
  5. 5 · Build the method ~8 min Collect the editor's own rollouts, build a target from unchanged source content, then train a copy to steer only its trajectory tail toward that target.
  6. 6 · The experiment ~6 min You’ll guess: After this tail-focused training cut drift across many editing turns, what happened to the base models' text-to-image and single-image editing performance?
  7. 7 · The viva ~5 min Three questions from the examiners, answered in your own words. Win it for the paper’s trophy.
Join free to play the whole quest ›

Free, with Google or an email address. Your stars and progress are kept.

KipQuest: the day’s AI research, as podcasts and quests. All papers Android app Privacy Contact Episodes are written and voiced by AI from each paper. Summaries can contain mistakes: the paper is the source.