We recently integrated message threads in Claude Code. On requests with 500K to 1M tokens, median time to first token is about 35% lower.
In long conversations, the median request went from about 800 KB to 1.8 KB.
Claude Code's message threads cut first-token latency about 35% on long requests
AIAnthropic says its recently integrated message threads in Claude Code reduce median time to first token by about 35% on requests with 500K to 1M tokens. In long conversations, the median request size dropped from about 800 KB to 1.8 KB.
Source details
ClaudeDevs · x.comPublished · added here
Original title: We recently integrated message threads in Claude Code. On requests with 500K to 1M tokens, median time to first token is about 35% lower.