Benchmark coding agents and agent harnesses on 226 deterministic file-editing tasks with byte-exact verification and a public leaderboard.
-
Updated
Oct 16, 2026 - JavaScript
Benchmark coding agents and agent harnesses on 226 deterministic file-editing tasks with byte-exact verification and a public leaderboard.
Live, open-source benchmark for comparing AI coding agents on real GitHub issues
A curated list of benchmarks, harnesses, leaderboards, and tools for evaluating AI coding agents.
Run coding agents from the same commit, verify patches with your repository's own checks, and compare results locally.
Okay, but prove it. Open-source conformance benchmark for the engineering around coding agents.
To associate your repository with the coding-agent-benchmark topic, visit your repo's landing page and select "manage topics."