reminder, this is today!
Hugging Face hosts a livestream on model quantization with llama.cpp and vLLM
AIHugging Face is hosting a livestream today on shrinking AI models to run on laptops, using quantization with llama.cpp and vLLM. Speakers include Merve Noyan, Maxime Labonne, Aditya Tadimeti, Bartowski, and mgoin.
@mervenoyann
Join us in this livestream next Tuesday, learn how to shrink models to fit in your laptop and make them go brrr 💨 We will have @mervenoyann @maximelabonne @TadimetiAditya @bartowski1182 and @mgoin_ giving a primer and know-hows on quantization with llama.cpp and vLLM ⚡️