Roy Rinberg open-sources FlashProve, a prototype proving 400B model inference
Overview
Roy Rinberg has open-sourced FlashProve, a research prototype that proves a 400B-parameter model runs at over 100 tokens per second on one H100 in prefill.
The announcement, posted on X, says the release is meant to encourage further progress in the field.
The report attributes the release to Anthropic, while the subject of the fact is Rinberg. The reports do not give further detail on the prototype's method or independent verification of the throughput figure.
Written by AI from the articles below · updated Nov 4, 1:25 AM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
Roy Rinberg@RoyRinbergXAnthropic open-sources FlashProve, a research prototype for proving large model inferenceAIAnthropic is open-sourcing FlashProve, a research prototype that proves a 400B model at over 100 tok/s on one H100 in prefill. The post frames it as a step toward more progress in the field.
Heat Trend
Not enough continuous observations to show a trend yet.