HarnessTax — SWE-bench Lite
照 HarnessTax (Arena) 发布的原样呈现:它的指标,它的模型。点模型名进本站详情,点箭头回到原榜。
- 许可协议
- 未声明
- 更新频率
- 已停更
- 本站抓取时间
- 2026-10-05
- 条目数
- 21
- Claude Fable 5
97.8%
- Claude Opus 4.8
88.9%
- GPT 5.6 Sol
77.8%
- Kimi K3
76.7% - Claude Sonnet 4.6
68.9%
- Claude Haiku 4.5
60.0%
- GPT 5.6 Luna
55.6%
21 个有分数
| # | 模型 | ||
|---|---|---|---|
| 1 | 97.8%93.3–100.0 | $1.33 | |
| 2 | 96.7%91.1–100.0 | $0.89 | |
| 3 | 96.7%91.1–100.0 | $0.67 | |
| 4 | 88.9%77.8–97.8 | $0.69 | |
| 5 | 86.7%75.6–95.6 | $0.98 | |
| 6 | 82.2%71.1–92.2 | $0.47 | |
| 7 | 77.8%63.3–90.0 | $1.54 | |
| 8 | 76.7%62.2–88.9 | $0.78 | |
| 9 | 74.4%58.9–88.9 | $0.44 | |
| 10 | 74.4%60.0–87.8 | $0.85 | |
| 11 | 73.3%57.8–87.8 | $0.56 | |
| 12 | 72.2%57.8–85.6 | $0.46 | |
| 13 | 68.9%53.3–83.3 | $0.74 | |
| 14 | 66.7%51.1–81.1 | $0.67 | |
| 15 | 64.4%47.8–80.0 | $0.68 | |
| 16 | 60.0%43.3–75.6 | $0.37 | |
| 17 | 57.8%41.1–74.4 | $0.39 | |
| 18 | 55.6%38.9–72.2 | $0.15 | |
| 19 | 55.6%37.8–72.2 | $0.04 | |
| 20 | 53.3%35.6–70.0 | $0.03 | |
| 21 | 52.2%36.7–67.8 | $0.43 |
每一列测的是什么
- SWE-bench Lite
- 越高越好 · 智能体编程
- Cost per rollout
- 越低越好