We estimate that FLOP/s alone understates GB300’s inference advantage over H100 by 10×. The standard AI chip comparison misses most of what matters for inference.
We’re introducing the Inference Performance Index (IPI), a new measure that accounts for memory bandwidth and inter-chip communication alongside compute. These factors determine how many users or agents a chip can support simultaneously at a given output speed.
Scores in GB300 equivalents let you compare chips directly and estimate the total inference capacity of a data center, or even the world.