Artificial Analysis Coding Agents
Shown as Artificial Analysis publishes it — their metrics, their models. A model name opens its page here; the arrow opens the original board.
- Published by
- Artificial Analysis
- Licence
- not stated
- Updates
- continuous
- Fetched
- 2026-10-06
- Entries
- 31 · 2 unmatched
- Claude Sonnet 5.5
0.684
- Claude Opus 5.5
0.660
- Gemini 4 Argon
0.638
- GPT 6.1 Sol
0.629
- Claude Fable 5.1
0.622
- Claude Fable 5.1 XHigh + SWE-2 Medium 0.617
- GPT 6 Astra
0.616
- Claude Opus 5
0.597
- GPT-6 Astra XHigh + SWE-2 Medium 0.589
- GPT 6 Sol
0.567
- Grok 4.7
0.563
- GPT 5.6 Sol
0.546
31 scored
| # | Model | ||||||
|---|---|---|---|---|---|---|---|
| 1 | 0.684 | 72.0% | 66.9% | 66.2% | $14.19 | 5244.97s | |
| 2 | 0.660 | 68.4% | 66.4% | 63.1% | $13.04 | 3867.09s | |
| 3 | 0.638 | 78.8% | 56.5% | 56.1% | $5.84 | 2070.17s | |
| 4 | 0.629 | 73.2% | 61.0% | 54.5% | $1.04 | 931.38s | |
| 5 | 0.629 | 68.4% | 62.1% | 58.1% | $3.33 | 1619.01s | |
| 6 | 0.622 | 64.3% | 64.8% | 57.6% | $12.39 | 2089.90s | |
| 7 | Claude Fable 5.1 XHigh + SWE-2 MediumDevin Fusion CLIUnmatched | 0.617 | 63.1% | 65.9% | 56.1% | $7.90 | 2146.99s |
| 8 | 0.616 | 67.6% | 61.8% | 55.6% | $7.47 | 1762.03s | |
| 9 | 0.614 | 72.0% | 60.8% | 51.5% | $0.70 | 651.32s | |
| 10 | 0.601 | 70.5% | 59.9% | 50.0% | $0.89 | 799.77s | |
| 11 | 0.601 | 69.6% | 57.8% | 53.0% | $1.55 | 1463.05s | |
| 12 | 0.597 | 62.5% | 62.1% | 54.5% | $10.79 | 2515.54s | |
| 13 | GPT-6 Astra XHigh + SWE-2 MediumDevin Fusion CLIUnmatched | 0.589 | 67.3% | 59.4% | 50.0% | $4.54 | 1481.90s |
| 14 | 0.572 | 67.6% | 55.1% | 49.0% | $0.50 | 517.81s | |
| 15 | 0.567 | 69.0% | 57.5% | 43.4% | $2.99 | 1338.05s | |
| 16 | 0.563 | 72.6% | 62.9% | 33.3% | $8.82 | 2354.37s | |
| 17 | 0.550 | 66.7% | 56.5% | 41.9% | $1.24 | 735.18s | |
| 18 | 0.546 | 72.3% | 54.0% | 37.4% | $6.35 | 1237.70s | |
| 19 | 0.543 | 71.7% | 59.4% | 31.8% | $3.98 | 1106.85s | |
| 20 | 0.536 | 61.4% | 59.4% | 39.9% | $4.24 | 2887.96s | |
| 21 | 0.519 | 68.4% | 66.1% | 21.2% | $5.05 | 3689.34s | |
| 22 | 0.483 | 73.2% | 54.6% | 17.2% | $3.47 | 1098.20s | |
| 23 | 0.470 | 64.9% | 58.3% | 17.7% | $3.57 | 1167.34s | |
| 24 | 0.459 | 65.5% | 44.9% | 27.3% | $0.62 | 510.77s | |
| 25 | 0.433 | 51.0% | 62.1% | 16.7% | $3.48 | 3784.42s | |
| 26 | 0.432 | 66.4% | 48.7% | 14.6% | $0.44 | 1412.26s | |
| 27 | 0.431 | 57.2% | 61.8% | 10.1% | $0.24 | 2417.55s | |
| 28 | 0.421 | 61.9% | 39.0% | 25.3% | $0.48 | 380.86s | |
| 29 | 0.419 | 65.8% | 45.2% | 14.6% | $2.47 | 702.71s | |
| 30 | 0.411 | 63.7% | 44.4% | 15.2% | $0.18 | 1285.93s | |
| 31 | 0.387 | 54.3% | 51.3% | 10.6% | $0.09 | 1097.04s |
What each column measures
- Artificial Analysis Coding Agent Index
- Higher is better · Agentic coding
- DeepSWE v1.1
- Higher is better
- SWE-Atlas-QnA
- Higher is better
- Terminal-Bench v4
- Higher is better · Agentic coding
- Cost
- Lower is better · Cost
- Execution Time
- Lower is better