# How Baseten builds production-grade speed and stability on SGLang

> Original title: 4 | @baseten

- Source: LMSYS Org
- Published: 2026-11-04T22:51:49.000Z
- Bad Influence: https://badinfluence.news/items/vodszolq3xtwp2ybuejswynfb
- Original: https://x.com/lmsysorg/status/2118114020536570075

## Summary

Baseten explains how it builds production serving speed and stability on top of SGLang, according to Pankaj Gupta. The post covers agent-driven optimization and peer-to-peer KV transfer behind that serving stack.

## Post

4 | @baseten 
Beyond Defaults: How Baseten Builds Production-Grade Speed and Stability on Top of SGLang

Pankaj Gupta on agent-driven optimization and peer-to-peer KV transfer behind Baseten's production serving.

![](https://badinfluence.news/api/img-proxy?u=https%3A%2F%2Fpbs.twimg.com%2Fmedia%2FHWULxlEaIAALW_F.jpg&mode=thumb&exp=1794096000&sig=71f0702eb9927541)