Skip to main content

3 docs tagged with "sampling"

View all tags

DDPM Sampling and Guidance

A trained diffusion model is only half the system. Diffusion Models trains a noise predictor — but how you turn that predictor into actual samples, how many steps you take, and what you condition on are all choices made after training, and they are where most of the practical control lives.

Decoding Strategies

The model outputs a probability distribution over the entire vocabulary at every step — something has to turn that distribution into an actual sequence of chosen tokens. That "something" is decoding, and it's a design decision entirely separate from the model itself: the same weights, decoded two different ways, can produce text that reads as either robotic and repetitive or lively and varied.

Flow Matching and Consistency Models

DDPM Sampling and Guidance got diffusion sampling down to tens of steps. This page covers the research direction aimed squarely at pushing that further — toward single-digit, and eventually single-step, generation, by rethinking what the network is trained to predict in the first place.