Hugging Face Blog·· 2022-06-07AI score20
Illustrated Diffusion Models: From DDPM to a Step-by-Step PyTorch Implementation
The Annotated Diffusion Model
AI briefing
This Hugging Face blog post takes an in-depth look at denoising diffusion probabilistic models (DDPM), based on the 2020 paper by Ho et al., with a step-by-step PyTorch implementation whose code references Phil Wang's implementation. The article covers both the forward noising and reverse denoising processes; the DDPM authors use T=1000 time steps, encode time steps with sinusoidal positional embeddings, and use Wide ResNet blocks as the core module of the U-Net.
Open original huggingface.co