Skip to content
View original post on X: Hugging FaceOfficial
Published
22/100

Hugging Face announces a livestream on quantizing models with llama.cpp and vLLM

AIHugging Face announces a livestream next Tuesday on shrinking models to fit laptops, with speakers covering quantization in llama.cpp and vLLM. The livestream includes a primer and practical know-how from Merve Noyan, Maxime Labonne, Aditya Tadimeti, Bartowski, and Michael Goin.
Hugging FaceVerified on XOfficial
@huggingface
View on X

Join us in this livestream next Tuesday, learn how to shrink models to fit in your laptop and make them go brrr 💨

We will have @mervenoyann @maximelabonne @TadimetiAditya @bartowski1182 and @mgoin_ giving a primer and know-hows on quantization with llama.cpp and vLLM ⚡️

Source details

Hugging Face · x.comPublished · added here

Original title: Join us in this livestream next Tuesday, learn how to shrink models to fit in your laptop and make them go brrr 💨

Topics

Hugging FaceDeployment & engineering

Tags

#Other