# Together AI introduces Together Compiler for continuous AI inference optimization

> Original title: Together Compiler: Continuous Compilation for AI inference

- Source: Together AI Blog
- Published: 2026-11-04T00:00:00.000Z
- Bad Influence: https://badinfluence.news/items/ca3s7mjdhvxjclcoox6jwu2a6
- Original: https://www.together.ai/blog/together-compiler-continuous-compilation-for-ai-inference

## Summary

Together AI introduces Together Compiler (TKCC), a system that uses agents to continuously optimize AI inference as traffic and hardware change. The post reports up to 2.6x higher TPS across frontier open-source models and 1111 TPS on MiniMax M3.1-Flash and 1205 TPS on DeepSeek v4.1-Flash on the InferenceX low-latency benchmark. It also reports 1.7x higher TPS than open-source megakernels on Llama 1B at batch size 1.