LiFT: Loop Flow Transformers
Loop Flow Transformers loop a shared diffusion transformer with depth-indexed regression targets, improving generation with more inference compute and fewer parameters than dense models.
Published Oct 4, 2026▲ 9 on Hugging FacearXiv ↗
Only vote on papers you've read. Sign in with GitHub to vote.
LiFT delivers a striking ImageNet FID gain with far fewer parameters via continuous-depth looped DiT cores, but its evaluation lacks error bars, COCO or text-to-image tests, and wall-clock proof that longer rollouts justify the inference cost.
Abstract
We introduce Loop Flow Transformers (LiFT), a family of looped generative models that scales computation by repeatedly applying a shared Diffusion Transformer (DiT) core, with only light changes to the standard architecture. Rather than asking every recurrent step for the final prediction, LiFT trains each step with a single regression target: a point on a straight path from the model's initial estimate to the flow-matching target. Because we index these targets by a continuous depth coordinate, a trained model can loop far beyond its training depth with no retraining, early exits, or other modifications. In our experiments, these longer rollouts improve generation, so inference computation can grow without adding parameters. On ImageNet at 256x256, LiFT-L/2 achieves an FID 3.34 points lower than our dense DiT-XL/2 baseline while using approximately 60% fewer parameters, 32% fewer training FLOPs, and 52% fewer inference FLOPs.