# Together AI introduces Together Compiler for continual AI inference optimization

> Original title: Together Compiler: Continual Compilation for AI inference

- Source: Together AI Blog
- Published: 2026-11-04T00:00:00.000Z
- Bad Influence: https://badinfluence.news/items/c6xe5dgwk8l1l7fisn3o31v6k
- Original: https://www.together.ai/blog/together-compiler-continual-compilation-for-ai-inference

## Summary

Together AI introduces Together Compiler (TKCC), a continual optimization loop that uses agents to tune inference for changing traffic and hardware. The company says it reaches up to 2.6x higher TPS across several open-source models and 1111 and 1205 TPS on MiniMax M3.1-Flash and DeepSeek v4.1-Flash in the InferenceX low-latency benchmark. Its persistent engines hot-reload candidate forward passes instead of restarting, cutting engine startup from 467 seconds to 9.0 seconds in its measurements.