Great work from the vLLM Semantic Router, KR Labs, and @AMD teams on Vela 3.0!
Routing decisions and span extraction in one call, with six open models from 0.3B to 27B. More flexibility in what the router can detect and how small it can run.
vLLM Semantic Router and AMD release Vela 3.0 span-extraction models
AIvLLM Semantic Router, KR Labs, and AMD released Vela 3.0, six open models from 0.3B to 27B parameters that return routing decisions and extracted spans in one call. The 380M model ranks first on the Decision Index among models up to 500M parameters, according to the post by Xunzhuo Liu.
@vllm_project
Introducing Vela 3.0 📡 Name it. Vela finds it. Six open models (0.3B–27B): decisions + the spans you name. One call. ⚡ 380M: #1 Decision Index ≤500M 🎯 Beats GPT-5-mini at zero-shot classification 🔍 18 ms per span question 🤗 https://huggingface.co/collections/vllm-sr/vela-30 #Jev #Decison
Source details
vLLM · x.comPublished · added here
Original title: Great work from the vLLM Semantic Router, KR Labs, and @AMD teams on Vela 3.0!