Skip to content
Trending storyDeveloping

Zhijian Liu explains DFlash and other speedups behind Inco's open-model endpoints

1 article1 sourcesince Nov 9Last article 2h ago ·

Overview

AISummary of 1 article

Zhijian Liu of Inco describes DFlash, a block-diffusion drafter now available in SGLang, and other optimizations behind Inco's open-model endpoints.

LMSYS Org shares his explanation on X, and the post also covers where the rest of the speed comes from. The report gives no speed figures, benchmarks, or endpoint pricing.

Written by AI from the articles below · updated Nov 9, 6:19 PM ET

Check the sources:

Latest developmentNov 9, 6:15 PM ET
Zhijian Liu explains DFlash and other speedups behind Inco's open-model endpoints

Article timeline

The articles in this story. Times are ET.

Nov 9
  1. LMSYS OrgOfficial
    Zhijian Liu explains DFlash and other speedups behind Inco's open-model endpoints

    AIZhijian Liu of Inco describes DFlash, a block-diffusion drafter now available in SGLang, and other optimizations behind Inco's open-model endpoints. The post also covers where the rest of the speed comes from.

    Image from @lmsysorg's post

Heat Trend

Not enough continuous observations to show a trend yet.