Skip to content
AI SYSTEM — Artificial Intelligence

Top-p (nucleus sampling)

Also: Top-k

A method that limits the choice of the next token to the most likely candidates.

With top-p = 0.9, the model only considers as many of the most likely tokens as needed to reach 90% combined probability and chooses from them. Very unlikely outliers are thus excluded.

Top-p is often used together with temperature. It is usually advisable to change only one of the two values.

General information, not legal or professional advice.