Skip to content
View original post on X: Lewis Tunstall
Published
26/100

Hugging Face reports 67% accuracy from code-grounded self-taught reasoning traces

AILewis Tunstall says his team built training explanations from facts computed in code plus the model's own sense of how unusual a mutation looks, without a teacher model. These grounded reasoning traces raised accuracy to about 67%, while the self-taught version stalled below 60%.
Lewis TunstallVerified on X
@_lewtun
View on X

Part of a thread · earlier post

What worked was skipping the teacher altogether!

After analysing the model errors and prompts more carefully, we realised that each training explanation could be assembled from facts computed in code, plus the model's own sense of how unusual the mutation looks.

With these grounded "reasoning traces", accuracy rose to about 67%. The self-taught version stalled below 60%.

Source details

Lewis Tunstall · x.comPublished

Original title: What worked was skipping the teacher altogether!