Mean Mode Screaming: Mean--Variance Split Residuals for 1000-Layer Diffusion Transformers
Pengqi Lu
Deep diffusion transformers face structural instability at extreme depths due to mean-dominated collapse triggered by mean mode screaming, which is mitigated through mean-variance split residuals that maintain stable training while preserving performance.