Prime Intellect says compaction summarizes a full context window and passes the summary to the next one, but each summary is a guess about what will matter later. Offloading memory to a filesystem or REPL avoids that guess, but files cannot reason, so the agent must load them back into its window and spend the context it was trying to save.
Part of a thread · earlier post
Compaction summarizes a full window and hands the summary to the next one, but every summary is a guess about what will matter later.
We can offload memory with a filesystem or REPL. But files can’t think. The agent has to pull them back into its window and spends the context it was trying to save.
Source: Prime Intellect · x.comPublished · added here
