Inworld just launched Inworld Inference, an LLM inference API built for consumer AI apps, serving open models including Gemma 4, GLM, DeepSeek, and MiMo.
@inworld optimizes how each model runs to deliver faster responses for tutors, companions, games, and other consumer apps.
On Gemma 4 26B, median time to first token is 0.17 seconds, compared with 0.61 seconds for the median of the other providers on OpenRouter - 3.6× faster.
At the 95th percentile, time to first token is 0.31 seconds versus 2.42 seconds for the median of those providers - 7.8× faster.
Developers can also set requests to switch automatically to a fallback model if the first model fails or takes too long.