Skip to content
View original post on X: vLLMOfficial
Published
38/100

vLLM Semantic Router introduces System Duo for fast and deep reasoning routing

AIvLLM Semantic Router introduces System Duo, which uses fast decision models for quick calls such as triage, guard, verify, and check. The router sends deep reasoning tasks to the right model only when needed.
vLLMVerified on XOfficial
@vllm_project
View on X

One router, two minds ๐Ÿง โšก

Huge work from @XunzhuoLiu and the vLLM Semantic Router team on System Duo โ€” fast decision models handle the blink-of-an-eye calls (triage, guard, verify, check), while the router sends deep reasoning to the right model only when it matters.

All open source, all running on vLLM โ†’ http://app.vllm-sr.ai

Xunzhuo@XunzhuoLiu
๐— ๐—ฎ๐—ธ๐—ฒ ๐˜†๐—ผ๐˜‚๐—ฟ ๐—ฎ๐—ด๐—ฒ๐—ป๐˜ ๐˜๐—ต๐—ถ๐—ป๐—ธ ๐—ณ๐—ฎ๐˜€๐˜ ๐—ฎ๐—ป๐—ฑ ๐˜€๐—น๐—ผ๐˜„. System One decides in a blink. System Two reasons in depth. ๐—ข๐—ป๐—ฒ ๐—ฟ๐—ผ๐˜‚๐˜๐—ฒ๐—ฟ. ๐—ง๐˜„๐—ผ ๐—บ๐—ถ๐—ป๐—ฑ๐˜€. ๐—œ๐—ป๐˜๐—ฟ๐—ผ๐—ฑ๐˜‚๐—ฐ๐—ถ๐—ป๐—ด ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ ๐——๐˜‚๐—ผ โ†’ https://app.vllm-sr.ai #Jev #SystemOne #SystemTwo #OpenSource
View quoted post on X
Source details

vLLM ยท x.comPublished

Original title: One router, two minds ๐Ÿง โšก