Representation-Space MMD for Diffusion Language Models
Post-training minimizes representation-space MMD between diffusion language model outputs and references via retained token features, improving perplexity, accuracy, and parallel decoding.
Published Oct 5, 2026▲ 16 on Hugging FaceCode ★ 10arXiv ↗
Only vote on papers you've read. Sign in with GitHub to vote.
Representation-space MMD efficiently post-trains diffusion language models with frozen feature matching and improved perplexity, though it lacks baselines against tuned KL or reward models and offers little theoretical novelty over older kernel methods.
Abstract
We introduce a post-training method for diffusion language models (DLMs) that minimizes Maximum Mean Discrepancy (MMD) between generated and reference distributions in the feature space of a frozen pretrained DLM. To estimate MMD, we retain contextual features at individual token positions, obtaining multiple observations per sequence from a single extractor pass. We optimize this objective using policy gradients for discrete models and direct differentiation through generated latents for continuous models. In both cases, computing the loss directly from these features enables efficient post-training without full sampling trajectories or jointly trained auxiliary models. Experiments show lower generative perplexity at comparable entropy on OpenWebText and better accuracy-computation trade-offs on GSM8K. On 16B DMax-LLaDA2.0 models with hybrid masked-uniform diffusion, we increase decoding parallelism with similar or higher accuracy on math and code benchmarks.