Tag: AI infrastructure

0

Headroom: Cutting LLM Token Costs Without Cutting Answers

Posted by

Your agentic app just ran a search. The tool returned 500 results as JSON. Your agent appended all of it and fired off an API call — 45,000 tokens to answer a question that needed maybe 4,500. Tejas Manohar, a senior engineer at Netflix, hit this problem every day. He was running out of tokens […]

Read More →
0

Understanding MCP: The Language That Helps AI Models Speak to Applications

Posted by

The Model Context Protocol (MCP) is an emerging approach to managing how language models interact with and understand context. In this blog post, I’ll explain what the Model Context Protocol is, why it matters, and how it’s shaping the future of AI interactions. What is the Model Context Protocol?The Model Context Protocol is a standardized […]

Read More →