Diffusion Language Models are Super Data Learners
Jinjie Ni, Qian Liu, Longxu Dou +5 authors
Diffusion language models outperform autoregressive models in low-data settings due to any-order modeling, iterative bidirectional denoising, and Monte Carlo augmentation, and maintain advantages even at scale.