Skip to content
View original post on X: ARC PrizeOfficial
Published
34/100

DeepSeek V4.1 Flash 1017 leads open-weight models on ARC-AGI-3

AIARC Prize reports DeepSeek V4.1 Flash 1017 scores 5.8% on ARC-AGI-3 at a $1.2K cost using the provider adapter harness, and 0.2% at $1.0K with the standard harness. The model leads open-weight models on ARC-AGI-3 (5.81%) and ARC-AGI-2 (78.1%), and ties the best open-weight score on ARC-AGI-1 (94.5%).
ARC PrizeVerified on XOfficial
@arcprize
View on X

DeepSeek V4.1 Flash 1017 from @deepseek_ai on ARC-AGI (Verified):

- ARC-AGI-3: 5.8%, $1.2K (provider adapter harness), 0.2%, $1.0K (standard harness)

It leads open-weight models on ARC-AGI-3 (5.81%) and ARC-AGI-2 (78.1%) and ties the best open-weight score on ARC-AGI-1 (94.5%).

Source details

ARC Prize · x.comPublished · added here

Original title: DeepSeek V4.1 Flash 1017 from @deepseek_ai on ARC-AGI (Verified):

Topics

DeepSeekReasoningOpen-source ecosystemChina AIEvals & benchmarks