Frontier models struggle to classify genetic variants as harmless or harmful
Overview
Lewis Tunstall says he tested three frontier models on classifying 1,000 genetic variants as harmless or harmful, and none gave a usable result across the set.
GPT-6.1 Sol returned bare labels with its reasoning encrypted. Gemini 4 Argon refused more than 50% of prompts, and Opus 5.5 ran out of tokens on about 20%. Tunstall adds that open-weight models performed barely better than random.
Written by AI from the articles below · updated Nov 2, 11:49 AM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
Lewis Tunstall@_lewtunXFrontier models struggle to classify genetic variants as harmless or harmfulAILewis Tunstall says three frontier models were tested on classifying 1,000 genetic variants as harmless or harmful. GPT-6.1 Sol returned bare labels with its reasoning encrypted, Gemini 4 Argon refused more than 50% of prompts, and Opus 5.5 ran out of tokens on about 20%. He adds that open-weight models performed barely better than random.

Heat Trend
Not enough continuous observations to show a trend yet.