ARC Prize reports that DeepSeek V4.1 Flash scored 3.3% on ARC-AGI-3 at a total evaluation cost of $878 using the provider adapter harness. Under the standard harness it scored 0.9% at $1.2k. ARC Prize says this is the first model it has evaluated on ARC-AGI-3 to score above 3% for under $1k in total cost.
DeepSeek V4.1 Flash from @deepseek_ai on ARC-AGI (Verified):
- ARC-AGI-3: 3.3%, $878 (provider adapter harness), 0.9%, $1.2k (standard harness)
DeepSeek V4.1 Flash is the first model we've evaluated on ARC-AGI-3 to score above 3% for under $1k in total evaluation cost.
Source: ARC Prize · x.comPublished · added here
