Trakkr finds most AI-cited statistics cannot be traced to original studies
Overview
Trakkr Research says that only 40% of 1,285 statistics cited by five AI assistants led to a study making the same claim, and 11% led to no source at all.
The firm asked the assistants 200 questions that called for a number, then traced each cited figure back through the pages given as sources.
The report says most cited pages repeated figures taken from other pages rather than from original research. It also found that when several assistants gave the same figure, that agreement did not make the figure more reliable.
Written by AI from the articles below · updated Oct 29, 11:35 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
- Hacker News · AI (150+ points)BlogMost statistics AI assistants quote cannot be traced to a real study
AITrakkr Research asked five AI assistants 200 questions that call for a number, then traced 1,285 cited statistics back to their sources. Only 40% reached a study saying the same thing, while 11% led nowhere at all. The report found that most cited pages repeat figures from elsewhere, and that agreement among assistants did not make a figure more reliable.
Heat Trend
Not enough continuous observations to show a trend yet.