Syd OS: enable Anthropic prompt caching in the agentic loop
Cache breakpoints on the system prompt and the last message of each request: each tool-loop iteration now reuses the growing conversation prefix instead of re-processing all previously read documents (~100k+ tokens per round on wiki builds). Large latency win between steps and ~10x input-cost cut on long runs. Request-only copies - stored messages never mutated. CLAUDE_PROMPT_CACHE=0 disables. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
| Repository | emileriksenkeev/sydOS |
|---|---|
| Author | emileriksenkeev <emil@keev.co> |
| Authored | |
| Parents | 0e4a313e |
| Stats | 1 file changed , +58 , -2 |
| Part of | Agentic chat run reliability and long-run streaming |
Capture this commit into my fork
Download a Markdown prompt that tells Claude how to port this
exact commit into your working tree. Run it via
claude -p < capture-commit-9aaaadc2.md
from inside the repo you want the change in.