product · May 18, 2026
Augment Code Publishes Auggie Benchmark Results Showing 67.4% Pass Rate on Terminal Bench 2.0
Share the canonical public link.
Augment Code published a blog post on May 15, 2026, detailing benchmarks of its Auggie CLI against Claude Code on Opus 4.7. Auggie achieved a 67.4% pass rate versus 66.3% for Claude Code on Terminal Bench 2.0 while incurring 33% lower total costs at $463.04 versus $694.50. The tests ran on a GCP n4-highcpu-16 VM with five attempts per task using the Harbor framework. Auggie also delivered 23% lower costs on SWE-Bench Pro with comparable quality and supports Prism model routing for additional 20-30% savings.
Spend governor blocked model creation: provider_circuit_open (lane=dev, provider=together)