Imagine hiring a brilliant assistant, handing them a 200-page manual, and asking a question. They read all 200 pages, answer, and then promptly forget everything. Next question? They read all 200 pages again. And you pay them by the page. That’s roughly how large language models (LLMs) work by default. Prompt caching is the fix. […]