Skip to content
View original post on X: SemiAnalysisX· 38/100AI score38/100

TOKENMAXXING: @vllm_project and @inferact achieve 1.3 BILLION tokens per $ of TCO (hyperscaler volume pricing) via disaggregated serving ...

AISummary

on AgentX. This result is 4x better than the B300 aggregated configuration.

Post on XView on X
SemiAnalysisVerified on X
@SemiAnalysis_

TOKENMAXXING: @vllm_project and @inferact achieve 1.3 BILLION tokens per $ of TCO (hyperscaler volume pricing) via disaggregated serving on AgentX.

This result is 4x better than the B300 aggregated configuration.

Source: SemiAnalysis · x.comPublished · added here

Topics

AI agentsDeployment & engineeringEvals & benchmarks