Great to see Step 5 Preview delivering strong inference performance on NVIDIA GB300.
Looking forward to seeing what developers build with it.
StepFun says Step 5 Preview delivers strong inference on NVIDIA GB300
AIStepFun says its Step 5 Preview delivers strong inference performance on NVIDIA GB300 GPUs. NVIDIA says the 600B MoE model runs at nearly 8K tokens per second per GPU using NVFP4, and that it is StepFun's largest open-weights release.
StepFunOfficial
@StepFun_ai
Congrats to StepFun on Step 5 Preview 🙌 Their largest open weights release. The 600B MoE model is built to handle agent tasks lasting up to 24 hours. The model runs at nearly 8K tokens/sec/GPU on NVIDIA GB300 using NVFP4. NVP4 checkpoint: https://huggingface.co/stepfun-ai/Step-5-Preview-NVFP4 Deploy with @SGL_project - https://docs.sglang.io/cookbook/autoregressive/StepFun/Step-5-Preview or @vLLM_project - https://recipes.vllm.ai/stepfun-ai/Step-5-Preview Post-train with NeMo Automodel: https://github.com/NVIDIA-NeMo/Automodel/blob/main/docs/model-coverage/llm/stepfun-ai/step-5-preview.mdx Run it with NVIDIA NIM using a single command: https://catalog.ngc.nvidia.com/orgs/nim/nvidia/containers/vllm-model-free-nim-experimental/-
Source details
StepFun · x.comPublished · added here
Original title: Great to see Step 5 Preview delivering strong inference performance on NVIDIA GB300.