Skip to main content

System status

Coverage is stale.

Collection is paused. Latest public event: Aug 21, 2026 (10 days ago).

← Intel index

This coverage is stale.

Last updated May 18, 2026 (about 4 months ago).

product · May 18, 2026

Augment Code Publishes Auggie Benchmark Results Showing 67.4% Pass Rate on Terminal Bench 2.0

Share the canonical public link.

Share as image

Augment Code published a blog post on May 15, 2026, detailing benchmarks of its Auggie CLI against Claude Code on Opus 4.7. Auggie achieved a 67.4% pass rate versus 66.3% for Claude Code on Terminal Bench 2.0 while incurring 33% lower total costs at $463.04 versus $694.50. The tests ran on a GCP n4-highcpu-16 VM with five attempts per task using the Harbor framework. Auggie also delivered 23% lower costs on SWE-Bench Pro with comparable quality and supports Prism model routing for additional 20-30% savings.

Spend governor blocked model creation: provider_circuit_open (lane=dev, provider=together)

Supporting evidence