Skip to content
Hugging Face Blog·· 2022-06-07AI score20

Illustrated Diffusion Models: From DDPM to a Step-by-Step PyTorch Implementation

The Annotated Diffusion Model

AI briefing

This Hugging Face blog post takes an in-depth look at denoising diffusion probabilistic models (DDPM), based on the 2020 paper by Ho et al., with a step-by-step PyTorch implementation whose code references Phil Wang's implementation. The article covers both the forward noising and reverse denoising processes; the DDPM authors use T=1000 time steps, encode time steps with sinusoidal positional embeddings, and use Wide ResNet blocks as the core module of the U-Net.

Open original huggingface.co