Skip to content
Trending storyDeveloping

Artificial Analysis rates DeepSeek V4.1 Flash endpoints consistent with reference

3 articles1 sourcesince Nov 5Last article 1h ago ·

Overview

AISummary of 3 articles

Artificial Analysis says all 22 DeepSeek V4.1 Flash 1017 endpoints score 97.5 to 101.4 against the self-hosted reference, a 3.9-point range that makes it the most consistent model in its Endpoint Accuracy Index.

The firm publishes these results alongside endpoint accuracy results for GLM-5.3 Flash, Muse Spark Open, GLM-5.3, Kimi K3 and gpt-oss-120b.

The index, now at v1.1, scores serverless endpoints as a percentage of self-hosted reference accuracy on BFCL-500, HLE-250 and AA-LCR-25. Artificial Analysis says nearly 1 in 4 of the more than 100 endpoints it benchmarked score below the reference. Two GLM-5.3 Flash endpoints capped at about 32K output tokens score 22% and 29% on HLE-250, against 55% for the reference.

Written by AI from the articles below · updated Nov 5, 9:53 PM ET

Check the sources:

Developments

3 developments

  1. Nov 5, 9:44 PM ET · 1 article
    Artificial Analysis reports DeepSeek V4.1 Flash endpoint consistency results
    Artificial Analysis: Artificial Analysis finds all 22 DeepSeek V4.1 Flash endpoints consistent with reference
  2. Nov 5, 9:44 PM ET · 1 article
    Artificial Analysis shares endpoint accuracy results for six models
    Artificial Analysis: Artificial Analysis shares endpoint accuracy results for six AI models
  3. Nov 5, 9:44 PM ET · 1 article
    Artificial Analysis launches Endpoint Accuracy Index v1.1
    Artificial Analysis: Artificial Analysis launches Endpoint Accuracy Index v1.1 with expanded model coverage

Article timeline

The articles in this story. Times are ET.

Nov 5
  1. Artificial AnalysisOfficial
    Artificial Analysis finds all 22 DeepSeek V4.1 Flash endpoints consistent with reference

    AIArtificial Analysis says all 22 DeepSeek V4.1 Flash 1017 endpoints are statistically in line with the reference, scoring 97.5 to 101.4. The 3.9-point range makes it the most consistent model in the Index.

    Image from @ArtificialAnlys's post
  2. Artificial AnalysisOfficial
    Artificial Analysis shares endpoint accuracy results for six AI models

    AIArtificial Analysis publishes endpoint accuracy results for GLM-5.3 Flash, Muse Spark Open, GLM-5.3, DeepSeek V4.1 Flash 1017, Kimi K3, and gpt-oss-120b. The full results and the methodology behind the Endpoint Accuracy Index are linked in the post.

  3. Artificial AnalysisOfficial
    Artificial Analysis launches Endpoint Accuracy Index v1.1 with expanded model coverage

    AIArtificial Analysis launches Endpoint Accuracy Index v1.1, which scores serverless endpoints as a percentage of self-hosted reference accuracy across BFCL-500, HLE-250 and AA-LCR-25. Across 100+ endpoints benchmarked, nearly 1 in 4 score below the reference, and the update adds GLM-5.3 Flash and Muse Spark Open. Two GLM-5.3 Flash endpoints capped at about 32K output tokens score 22% and 29% on HLE-250 against 55% for the reference.

    Image from @ArtificialAnlys's post

Heat Trend

Not enough continuous observations to show a trend yet.