A clinic puts a deployed chat model behind its booking website. Whatever a patient types, every reply must stay friendly and must decline to give medical advice. Where should the developers place these rules?
Choose an answer to check it. Afterward, select any option to review its explanation.
Standing rules for tone and limits belong in the system prompt: the model answers every user prompt while obeying that guidance, so the rules hold whatever patients type.
TPM governs throughput on the deployment; it cannot express rules about tone or forbidden topics.
Tempting because history is resent with each prompt, but its job is to keep earlier questions and answers in context; it records what was said rather than defining how the model must behave.
Temperature trades predictability for creativity; raising it makes replies less controlled, not rule-bound.
id q0e9dfc19c3