Sometimes, all you have to do is ask.
We are open-sourcing a research prototype which we hope leads to more progress in this field. FlashProve is open source and proves a 400B model at over 100 tok/s on one H100 in prefill.
https://x.com/AnthropicAI/status/2117710942826123294?a=YW8M1x3fQrxkTNhD5eM&s=20
