Skip to content
Read the original: vLLM· Published 31/100AI score31/100

vLLM Semantic Router releases Decision 2.0 with open models from 0.6B to 27B

Original titleDecision 2.0 is out for vLLM Semantic Router!

AISummary

vLLM Semantic Router has released Decision 2.0, featuring open models ranging from 0.6B to 27B parameters. The models can answer 64 questions about a request in a single forward pass, are licensed under Apache-2.0, and load with Transformers.

Read the original x.com

Source: vLLM · x.comPublished · added here