AI tokens are another resource to optimize in software engineering now.
Original titleAI tokens are another resource to optimize in software engineering now. My cofounder @pwendell wrote about how we and other tech companie...
AISummary
My cofounder @pwendell wrote about how we and other tech companies are starting to manage this resource now, by routing everything through an AI Gateway.
This enables centralized analysis (e.g. we found settings we can change on Claude Code and Codex to lower cost a lot), smart routing, and “pushing down” control to our engineers so they can set budgets on individual tasks and prevent surprises.
Source: Matei Zaharia · x.com