Skip to content
Trending storyDeveloping

Frontier models struggle to classify genetic variants as harmless or harmful

1 article1 sourcesince Nov 2Last article 2h ago ·

Overview

AISummary of 1 article

Lewis Tunstall says he tested three frontier models on classifying 1,000 genetic variants as harmless or harmful, and none gave a usable result across the set.

GPT-6.1 Sol returned bare labels with its reasoning encrypted. Gemini 4 Argon refused more than 50% of prompts, and Opus 5.5 ran out of tokens on about 20%. Tunstall adds that open-weight models performed barely better than random.

Written by AI from the articles below · updated Nov 2, 11:49 AM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Nov 2
  1. Lewis TunstallX
    Frontier models struggle to classify genetic variants as harmless or harmful

    AILewis Tunstall says three frontier models were tested on classifying 1,000 genetic variants as harmless or harmful. GPT-6.1 Sol returned bare labels with its reasoning encrypted, Gemini 4 Argon refused more than 50% of prompts, and Opus 5.5 ran out of tokens on about 20%. He adds that open-weight models performed barely better than random.

    Image from @_lewtun's post

Heat Trend

Not enough continuous observations to show a trend yet.