Skip to content
Trending storyDeveloping

StepFun credits RadixArk for running Step 5 Preview production inference on SGLang

1 article1 sourcesince Oct 15Last article 1h ago ·

Overview

AISummary of 1 article

StepFun thanks RadixArk for helping power its Step 5 Preview in production with SGLang, the inference framework, and says the setup enables efficient, scalable inference for real-world workloads.

RadixArk says it helps run StepFun's first-party production API with SGLang at scale, using cache-aware routing. RadixArk also says Step 5 Preview has open weights and can be deployed with SGLang. These are the companies' own statements, and the report does not include independent performance measurements.

Written by AI from the articles below · updated Oct 15, 6:24 PM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Oct 15
  1. StepFunOfficial
    StepFun thanks RadixArk for powering Step 5 Preview with SGLang in production

    AIStepFun thanks RadixArk for helping power Step 5 Preview in production with SGLang, which it says enables efficient, scalable inference for real-world workloads. RadixArk says it helps run StepFun's first-party production API with SGLang at scale, using cache-aware routing. RadixArk also says Step 5 Preview has open weights and can be deployed with SGLang.

Heat trend

Not enough continuous observations to show a trend yet.