Alex Albert @alexalbert__

We just rolled out prompt caching in the Anthropic API.

It cuts API input costs by up to 90% and reduces latency by up to 80%.

Here's how it works:

Aug 14, 2024 View on X →

https://x.com/alexalbert__/status/1823751966893465630