Skip to content
Trending storyDeveloping

Dex Horthy says compaction is good enough to keep AI threads running longer

1 article1 sourcesince Nov 7Last article 1h ago ·

Overview

AISummary of 1 article

Dex Horthy says improved compaction now lets users keep some model threads going without clearing or externalizing context.

In a post on X, he says he sets autocompact to 400k tokens and runs manual compacts between 200k and 400k tokens, depending on the model and harness. He also says three-level subagent architectures help, because a top-level orchestrator can launch subagents that launch their own subagents. The post covers his own setup and does not include benchmark results.

Written by AI from the articles below · updated Nov 7, 3:47 PM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Nov 7
  1. dexX
    Dex Horthy says compaction is now good enough to keep threads alive longer

    AIDex Horthy says compaction has improved enough that for some tasks users no longer need to clear or externalize context to keep models focused. He says he sets autocompact to 400k and runs manual compacts between 200k and 400k tokens, depending on the model and harness. He adds that three-level subagent architectures help, since a top-level orchestrator can launch subagents that launch their own.

Heat Trend

Not enough continuous observations to show a trend yet.