Artificial Analysis benchmarks Kimi K3 serving on AMD MI355X against NVIDIA B300
Article timeline
The articles in this story. Times are ET.
Artificial Analysis@ArtificialAnlysOfficialKimi K3 serves 8M tokens/s per MW on MI355X, about a third of B300AIArtificial Analysis says Kimi K3, with 2.8T total and 104B active parameters, serves about 8M tokens/s per MW on AMD MI355X at 50 tok/s per user, roughly a third of the roughly 24M reached on NVIDIA B300 with multi-node disaggregated configs. The MI355X curve peaks at about 13M tokens/s per MW at 12 tok/s per user. For a single agent, MI355X reaches 152 tok/s against 235 tok/s on B300.
- Artificial Analysis@ArtificialAnlysOfficialKimi K3 serves 8M tokens/s per MW on MI355X, about a third of B300
AIArtificial Analysis says Kimi K3, with 2.8T total and 104B active parameters, serves about 8M tokens/s per MW on AMD MI355X at 50 tok/s per user, roughly a third of the roughly 24M reached on NVIDIA B300 with multi-node disaggregated configs. The MI355X curve peaks at about 13M tokens/s per MW at 12 tok/s per user. For a single agent, MI355X reaches 152 tok/s against 235 tok/s on B300.
