Anthropic launches Message threads public beta, cutting TTFT about 35 percent on long contexts
Anthropic's Message threads public beta cuts median TTFT by about 35 percent for requests between 500k and 1M tokens, with threads held encrypted in memory for five minutes.
Anthropic opened public beta of the Message threads feature on its Claude platform on November 2. The capability lets agents send only new incremental content across long multi-turn conversations, avoiding the first token latency that grows from repeatedly resending hundreds of thousands of tokens of history.
With a thread parameter added to Messages API requests, the first request sends the full conversation and creates a thread, and subsequent requests send only new messages plus the ID of the previous response. Anthropic holds the conversation between requests in memory, encrypted, and does not write it to disk, with threads expiring five minutes after the last request, after which the client must resend the full conversation to create a new thread.
On performance, for requests between 500k and 1M tokens median time to first token drops by about 35 percent, and the feature is enabled by default for most Claude Code users. Anthropic says the more context an agent carries, the more message threads typically reduces time to first token.
Anthropic also explained that although subsequent requests are smaller on the wire, Claude still reads the full conversation context each turn, so token usage stays the same and the savings come from request transmission and context preprocessing time. Standard Claude token rates and existing rate limits continue to apply. The feature suits long-running coding agents, computer use agents and document and image heavy workflows.