Thank you @vllm_project for the day-0 vLLM-Omni support and for making Ming-3.0 easier to deploy!
Ant Ling thanks vLLM for day-0 Ming-3.0 support
AIAnt Ling thanks vLLM for day-0 vLLM-Omni support that makes Ming-3.0 easier to deploy. vLLM says Ant Ling open-sourced five speech models for TTS, audio understanding, and ASR, ranging from 0.5B to 126B total parameters with 6.5B active. Those models can be served now with vLLM-Omni.
@AntLingAGI
Day-0 support for Ming-3.0 in vLLM-Omni @AntLingAGI just open-sourced 5 speech models spanning TTS, audio understanding, and ASR — ranging from 0.5B to 126B total parameters (6.5B active). Serve them today with vLLM-Omni. Congrats to the @AntLingAGI team!View quoted post on X
Source details
Ant Ling · x.comPublished
Original title: Thank you @vllm_project for the day-0 vLLM-Omni support and for making Ming-3.0 easier to deploy!