Diffusion model

During training, a diffusion model learns to restore images that have been artificially noised. To generate, it starts with pure random noise and “denoises” it in many small steps – guided by a text prompt – into a new image.

Diffusion models power many well-known image and video generators. Newer systems combine the principle with transformer architectures.