Prompt Caching in the API
OpenAI's API now automatically discounts costs for repeated input tokens, offering meaningful price optimization for applications with shared context.
Excerpt
Offering automatic discounts on inputs that the model has recently seen
Read at source: https://openai.com/index/api-prompt-caching