AI Costs

GPT-6 Improves Prompt Caching to Cut Latency and Costs

GPT-6 improves prompt caching with higher hit rates, new diagnostics, explicit breakpoints and controls intended to reduce latency and costs for its users.