The era of efficiency
- Inference: serving got much cheaper - fell from 88% of revenue to 15% in a year, with revenue up 14× and the serving bill up only 2.3×. Serving is only about a quarter of their roughly $8.9B compute bill. The filing names open-weight models as a pricing risk 👀👀
- Training: Claude helping build the next Claude (everyone is doing it now), and running on four kinds of chips. Compute outside serving, mostly training and research, grew about 5×.
