System prompts vs. user prompts
System prompts and user prompts serve different purposes in shaping model behavior. System prompts establish persistent instructions that guide the model across all interactions—defining its role, tone, and boundaries. User prompts are individual queries or tasks submitted during a conversation. Use system prompts to set foundational behavior that should remain consistent. Use user prompts for specific, one-time requests. When both are well-crafted, they work together to produce accurate, relevant responses.The CARE framework
When crafting a system prompt, use the CARE framework to ensure you’ve covered the essential components: Not every prompt requires all four components, but reviewing each helps identify gaps that could lead to unclear or unhelpful responses.System prompt best practices
The following practices help you write system prompts that produce consistent, useful responses.Iterative refinement
Effective system prompts rarely emerge fully formed. Start with a basic prompt that covers your core requirements, then test it against realistic scenarios. Refine based on the results. When your prompt produces unexpected results, use the following guidance to identify and address the problem: Small, targeted adjustments typically yield better results than rewriting prompts from scratch.Documenting your prompts
As you develop effective system prompts, consider documenting them for reuse and sharing. A consistent format makes prompts easier to maintain and adapt.Examples
Model with tools
Model with tools
The following system prompt is for a data analyst with access to a database query tool and a Jupyter notebook tool. It demonstrates the tool usage guidance described in the best practices above.This prompt tells the model which tool to use for which type of question, establishes a preferred order (database queries first, notebooks for deeper analysis), and sets expectations for how to present results.
Model without tools
Model without tools
The following system prompt incorporates the best practices outlined above for a model without tools.