Joint representation learning and generation challenge a familiar tradeoff

DEM trains image representations and generation under a shared denoising objective, reporting 70.65% linear-probe accuracy and 39.85 FID-5k on ImageNet-100 at 64×64, with metrics often improving together. Its representations still trail non-generative SSL and some early gains may not hold at longer training, so broader validation is needed.