Skip to content
Read the original: Redwood Research Blog· Published 60/100AI score60/100

Filler tokens let GPT-6 Astra solve harder reasoning tasks without visible reasoning

Original titleAstra is much better at reasoning with filler tokens than previous models

AISummary

Redwood Research found that padding prompts with meaningless filler tokens improves GPT-6-Astra's no-reasoning answers on serial reasoning tasks, rising from about 10-20% to about 50% on 4-hop natural facts. Other tested models improved far less, and the authors argue this means Astra can perform cognition it does not verbalize in its chain of thought, making such monitoring harder.

Read the original blog.redwoodresearch.org

Source: Redwood Research Blog · blog.redwoodresearch.orgPublished · added here