Full Technical Findings & Reproducible Telemetry
1. Net Task Tokens vs. Gross Server Spend
Most industry benchmarks only report the happy-path tokens of tasks that succeeded. Over 14 days in production (850 model calls, 40.6M input tokens, 17.6M output tokens), we measure both metrics transparently: 586,759 net tokens on merged task rows versus 4,476,923 gross tokens when unmerged retries, background daemons, and planning revisions are included.
Metric | 14d Baseline | Post-Optimization Target
----------------------------------------+----------------------+---------------------------
Net tokens on merged task rows / PR | 586,759 | ~400,000
Gross server tokens / merged PR | 4,476,923 | <= 2,800,000 (-38%)
Developer CLI turns / merged PR | 9.5 calls (35.0M) | < 6.0 calls (< 2.0M/merge)
Planning tokens / merged PR (5 roles) | 650,000 (8.4M total) | < 300,000 (SHA-256 cache)2. Eliminating Transcript Replay in Resumed CLI Sessions
When a coding agent completes a vertical slice and spawns sequential follow-up processes for completeness, test coverage, typechecking, and linting, each resumed turn re-ingest the entire conversation transcript. Executing all deterministic static gates upfront and batching the union of failures into a single resumed turn eliminates three redundant context replays per slice.