Dex Horthy says compaction is good enough to keep AI threads running longer
Overview
Dex Horthy says improved compaction now lets users keep some model threads going without clearing or externalizing context.
In a post on X, he says he sets autocompact to 400k tokens and runs manual compacts between 200k and 400k tokens, depending on the model and harness. He also says three-level subagent architectures help, because a top-level orchestrator can launch subagents that launch their own subagents. The post covers his own setup and does not include benchmark results.
Written by AI from the articles below · updated Nov 7, 3:47 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
dex@dexhorthyXDex Horthy says compaction is now good enough to keep threads alive longerAIDex Horthy says compaction has improved enough that for some tasks users no longer need to clear or externalize context to keep models focused. He says he sets autocompact to 400k and runs manual compacts between 200k and 400k tokens, depending on the model and harness. He adds that three-level subagent architectures help, since a top-level orchestrator can launch subagents that launch their own.
Heat Trend
Not enough continuous observations to show a trend yet.