Artificial Analysis rates DeepSeek V4.1 Flash endpoints consistent with reference
Overview
Artificial Analysis says all 22 DeepSeek V4.1 Flash 1017 endpoints score 97.5 to 101.4 against the self-hosted reference, a 3.9-point range that makes it the most consistent model in its Endpoint Accuracy Index.
The firm publishes these results alongside endpoint accuracy results for GLM-5.3 Flash, Muse Spark Open, GLM-5.3, Kimi K3 and gpt-oss-120b.
The index, now at v1.1, scores serverless endpoints as a percentage of self-hosted reference accuracy on BFCL-500, HLE-250 and AA-LCR-25. Artificial Analysis says nearly 1 in 4 of the more than 100 endpoints it benchmarked score below the reference. Two GLM-5.3 Flash endpoints capped at about 32K output tokens score 22% and 29% on HLE-250, against 55% for the reference.
Written by AI from the articles below · updated Nov 5, 9:53 PM ET
Check the sources:
Developments
3 developments
- Nov 5, 9:44 PM ET · 1 articleArtificial Analysis reports DeepSeek V4.1 Flash endpoint consistency resultsArtificial Analysis: Artificial Analysis finds all 22 DeepSeek V4.1 Flash endpoints consistent with reference
- Nov 5, 9:44 PM ET · 1 articleArtificial Analysis shares endpoint accuracy results for six modelsArtificial Analysis: Artificial Analysis shares endpoint accuracy results for six AI models
- Nov 5, 9:44 PM ET · 1 articleArtificial Analysis launches Endpoint Accuracy Index v1.1Artificial Analysis: Artificial Analysis launches Endpoint Accuracy Index v1.1 with expanded model coverage
Article timeline
The articles in this story. Times are ET.
Artificial Analysis@ArtificialAnlysOfficialArtificial Analysis finds all 22 DeepSeek V4.1 Flash endpoints consistent with referenceAIArtificial Analysis says all 22 DeepSeek V4.1 Flash 1017 endpoints are statistically in line with the reference, scoring 97.5 to 101.4. The 3.9-point range makes it the most consistent model in the Index.

Artificial Analysis@ArtificialAnlysOfficialArtificial Analysis shares endpoint accuracy results for six AI modelsAIArtificial Analysis publishes endpoint accuracy results for GLM-5.3 Flash, Muse Spark Open, GLM-5.3, DeepSeek V4.1 Flash 1017, Kimi K3, and gpt-oss-120b. The full results and the methodology behind the Endpoint Accuracy Index are linked in the post.
Artificial Analysis@ArtificialAnlysOfficialArtificial Analysis launches Endpoint Accuracy Index v1.1 with expanded model coverageAIArtificial Analysis launches Endpoint Accuracy Index v1.1, which scores serverless endpoints as a percentage of self-hosted reference accuracy across BFCL-500, HLE-250 and AA-LCR-25. Across 100+ endpoints benchmarked, nearly 1 in 4 score below the reference, and the update adds GLM-5.3 Flash and Muse Spark Open. Two GLM-5.3 Flash endpoints capped at about 32K output tokens score 22% and 29% on HLE-250 against 55% for the reference.

Heat Trend
Not enough continuous observations to show a trend yet.