PixSDS: Why Latent SDS Makes Noisy Pixels
Latent SDS can keep the VAE latent clean while the pixel image drifts into visible artifacts.
The paper identifies VAE-induced pixel drift as the failure mode behind structured color artifacts and high-frequency texture noise. Its experiments show that weakly constrained pixel-space directions can accumulate noise even when the latent representation stays semantically meaningful. PixSDS repairs the gradient by decoding a latent SDS lookahead step and using that decoded image as a cleaner pixel-space direction. The method reduces VAE-inconsistent motion without retraining the diffusion model, changing the renderer, or replacing SDS. HF Daily Papers' note
The paper identifies VAE-induced pixel drift as the failure mode behind structured color artifacts and high-frequency texture noise. Its experiments show that weakly constrained pixel-space directions can accumulate noise even when the latent representation stays semantically meaningful. PixSDS repairs the gradient by decoding a latent SDS lookahead step and using that decoded image as a cleaner pixel-space direction. The method reduces VAE-inconsistent motion without retraining the diffusion model, changing the renderer, or replacing SDS. HF Daily Papers' note
score 4