Anthropic released Message Threads for the Messages API, enabling agents to transmit only conversation changes rather than resending full context with each turn. For requests between 500,000 and one million tokens, time to first token (TTFT) drops by approximately 35 percent. (The Decoder)
Zyphra AI introduced Zyphra Hierarchical Attention (ZHA), a tree-indexed sparse attention method that retrofits frozen large language models with 4 billion tokens of distillation. The approach reportedly matches dense attention performance on reasoning and 256K retrieval benchmarks while reducing computational overhead. (MarkTechPost) In separate tooling news, OpenAI published Pando, a Git-compatible backend for its monorepo that handles branches independently and achieves nearly 80 percent median push latency reduction while delivering roughly one petabyte of Git data per day. (MarkTechPost)