# UC Santa Barbara's TTME beats test-time training on math discovery with less compute

> Original title: New UC Santa Barbara paper shows that LLM math discovery can skip test-time training, since an evolving memory scored better and used far...

- Source: Rohan Paul
- Published: 2026-10-29T05:15:00.000Z
- Bad Influence: https://badinfluence.news/items/i36ribmelapl5jc5159skqci5
- Original: https://x.com/rohanpaul_ai/status/2115673734497382475

## Summary

UC Santa Barbara researchers present TTME, which keeps model weights fixed and stores lessons from earlier attempts in memory. Across 5 math tasks, 2 frameworks, and 3 models, TTME beat the reported test-time training scores in every case. With Qwen3-8B on 3 tasks, it used 82.8% to 84.6% fewer FLOPs and 47.7% to 58.4% less runtime.

## Post

New UC Santa Barbara paper shows that LLM math discovery can skip test-time training, since an evolving memory scored better and used far less compute.

i.e. evolving memory beats test-time training on math discovery, with far less compute.

Test-time training lets a model improve during a search by running RL on its own scored attempts. Those weight updates are slow and costly, so the method is hard to scale to bigger models.

They built TTME, which keeps the weights fixed and stores lessons in memory. The memory holds practical coding rules from earlier tries and the ideas behind score gains, which guide later attempts.

Across 5 math tasks, 2 frameworks, and 3 models, TTME beat the reported test-time training scores every time. With Qwen3-8B on 3 tasks, it used 82.8% to 84.6% fewer FLOPs and 47.7% to 58.4% less runtime than test-time training.

If your LLM search loop has an automatic checker, try a memory of lessons before paying for weight updates mid-search.

![](https://badinfluence.news/api/img-proxy?u=https%3A%2F%2Fpbs.twimg.com%2Fmedia%2FHVxURywbYAAD3zj.jpg&mode=thumb&exp=1793491200&sig=3c18d019757c258c)