Temperature
A setting that controls randomness in a model’s output. Low values give consistent answers, higher values more variety.
01In short
A setting that controls randomness in a model’s output. Low values give consistent answers, higher values more variety.
In productionFor business processes, keep it low and let evals prove consistency.
02Video
slot · videoTemperature in 90 secondsadd: GUIDES['temperature'].video
03Guide
slot · guide
A step-by-step guide for “Temperature” goes here. Suggested outline:
- What it is — in one paragraph
- Why it matters in production
- How to do it — 3 to 7 steps
- Pitfalls we see in the field
04Checklist
slot · checklist
Four to eight things a team can tick before go-live.
05FAQ
slot · FAQ
The three questions clients actually ask about “Temperature”.
06Related terms
BasicsInferenceRunning a trained model to get an output. In production it is the part you pay for on every single request.BasicsAISoftware that performs tasks we would otherwise call thinking: recognising, predicting, writing, deciding. Today it mostly means machine-learning models, not hand-written rules.BasicsContext windowHow many tokens a model can take into account at once: instructions, documents, conversation and its own answer.
Talk to us