Temperature

At low temperature the model almost always chooses the most likely tokens – answers become factual and repeatable. At high temperature less likely tokens get a chance too – texts become more varied but also more error-prone.

Low temperature suits data extraction and classification; higher temperature suits brainstorming and creative writing. In chat interfaces the value is usually fixed; via APIs it can be adjusted.