Skip to content
Trending storyDeveloping

Mercor analysis finds 90% of US working hours lack AI benchmark coverage

1 article1 sourcesince Oct 16Last article 3h ago ·

Overview

AISummary of 1 article

Mercor says about 90% of American working hours are spent on tasks with little or no coverage from existing AI benchmarks.

The company mapped 923 O*NET occupations against an initial list of 29 benchmarks. Coverage is concentrated in high-wage, AI-exposed occupations such as lawyers, while smaller middle-income knowledge jobs are undercovered.

Mercor describes the findings as provisional because the study relies on that initial benchmark list. The report proposes weighting model scores by O*NET task so that benchmark results better reflect the work people actually do.

Written by AI from the articles below · updated Oct 16, 3:29 PM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Oct 16
  1. Hacker News · AI (150+ points)Blog
    Mercor finds 90% of US working hours fall outside AI benchmark coverage

    AIMercor reports that about 90% of American working hours are spent on tasks with little or no coverage from existing AI benchmarks. Coverage is concentrated in high-wage, AI-exposed occupations such as lawyers, while smaller middle-income knowledge jobs are undercovered. The findings are provisional because the study uses an initial list of 29 benchmarks, and the report proposes weighting model scores by O*NET task.

Heat trend

Not enough continuous observations to show a trend yet.