Prompt caching is now generally available on DigitalOcean Serverless Inference, across supported models in our open model catalog, with no changes to your request code required. Cached Input is billed at up to 90% off and time to first token drops by up to 80%.