# Google Research adds a "sleep" phase to continual learning for LLMs

> Original title: Today on the blog, learn about our new instance of a “sleep” phase in continual learning, which enables LLMs to continuously integrate ne...

- Source: Google Research
- Published: 2026-10-27T17:40:42.000Z
- Bad Influence: https://badinfluence.news/items/d46uq4l0yvyezk6so4orniu24
- Original: https://x.com/GoogleResearch/status/2115136620446019795

## Summary

Google Research says it has developed a "sleep" phase for continual learning that lets LLMs keep integrating new facts and improve reasoning. The method aims to reduce catastrophic forgetting and static knowledge cutoffs. The company describes the work in a blog post.

## Post

Today on the blog, learn about our new instance of a “sleep” phase in continual learning, which enables LLMs to continuously integrate new facts and enhance reasoning while mitigating catastrophic forgetting or static knowledge cutoffs.

More →https://goo.gle/4iICkyD

![Overview of our sleep framework: Input streams from the active phase are stored in short-term memory before entering the sleep cycle, which bifurcates into Consolidation (transferring fragile short-term tokens into expanded long-term parametric memory using low-rank structures and MoE) and Dreaming (autonomous self-improvement via synthetic routing with random experts and RL refinement).](https://badinfluence.news/api/img-proxy?u=https%3A%2F%2Fpbs.twimg.com%2Fmedia%2FHVp5VQBagAAIAXY.jpg&mode=thumb&exp=1793404800&sig=303e21450f801819)