# LinkedIn describes serving an ads ranker with SLM and SGLang

> Original title: 1 | @LinkedIn

- Source: LMSYS Org
- Published: 2026-11-04T22:51:47.000Z
- Bad Influence: https://badinfluence.news/items/w99l15adcdx0kxpr4rhx2rrjl
- Original: https://x.com/lmsysorg/status/2118114011791376880

## Summary

Xianxing Zhang explains how LinkedIn serves its ads ranker at more than 10K QPS with under 80 ms scoring latency. The post uses SLM and SGLang for the serving stack.

## Post

1 | @LinkedIn 
Ads Ranking with SLM and SGLang at LinkedIn

Xianxing Zhang on serving an ads ranker at 10K+ QPS with under 80 ms scoring latency.

![](https://badinfluence.news/api/img-proxy?u=https%3A%2F%2Fpbs.twimg.com%2Fmedia%2FHWULenZbMAEkw5n.jpg&mode=thumb&exp=1794096000&sig=77f94b87d54e8442)