Skip to content
View original post on X: ARC PrizeOfficial
Published
36/100

ARC Prize says Fable 5.2 max scored 65.7% on ARC-AGI-3, below xhigh's 81.2%

AIARC Prize reports that Fable 5.2 scored 65.7% on ARC-AGI-3 at max reasoning effort, versus 81.2% at xhigh. It says 28 of 55 semi-private games hit the 12-hour runtime limit, and it expects max would have scored higher without that cap.
ARC PrizeVerified on XOfficial
@arcprize
View on X

Part of a thread · earlier post

At max reasoning with the standard harness, 28 of 55 semi-private games reached the 12-hour runtime limit, capping how far testing could progress. Max scored 65.7% on ARC-AGI-3 versus 81.2% at xhigh; without the limit, we expect max would have scored higher.

Also note that the released Fable 5.2 uses different tuning at medium and xhigh reasoning effort than the earlier checkpoint we evaluated. Low, high, and max are unchanged.

Source details

ARC Prize · x.comPublished · added here

Original title: At max reasoning with the standard harness, 28 of 55 semi-private games reached the 12-hour runtime limit, capping how far testing could ...