Thanks for the shoutout @SemiAnalysis_! Our team at @inferact has been optimizing @vllm_project on GB300, and those gains translate directly into better TCO. More optimizations are coming soon. Current results on InferenceX:
Thanks for the shoutout @SemiAnalysis_! Our team at @inferact has been optimizing @vllm_project on GB300, and those gains translate directly into better TCO. More optimizations are coming soon.
Current results on InferenceX: https://inferencex.semianalysis.com/
ALERT🚨🚨: @vllm_project, @Inferact & NVIDIA TOOK CO-DESIGN TO THE EXTREME WITH A GB300 NVL72 INFERENCE OPTIMIZATION TO GET 🚀 7.2x 🚀 BETTER PERF PER TCO THAN LITERALLY EVERY OTHER AI CHIP, using an inference co-design optimization called wideEP take full advantage of the NVL72 BACKPLANE. We explain below👇️ (1/3)🧵
Source: Inferact · x.comPublished · added here
