代理式工作
軟體開發以外、取自真實職業的多步任務,比如試算表、文件、客戶服務流程,由模型藉助工具完成。
按它在多少項基準裡進入前 10 排序,一樣多時看最好名次。每列保持各自的排名,不做平均。
| 模型 | 進入前 10 | Artificial Analysis LLM Leaderboard τ³-Banking | Artificial Analysis LLM Leaderboard GDPval-AA | Arena — Agent Overall |
|---|---|---|---|---|
| | 3/3 | #6 47.2% | #3 62.9% | #1 0.143 |
| | 2/3 | #1 51.3% | #8 58.6% | #22 0.025 |
| | 2/3 | — | #1 68.3% | #2 0.138 |
| | 2/3 | — | #2 67.0% | #3 0.125 |
| | 2/3 | #3 50.5% | #7 59.2% | #17 0.040 |
| | 2/3 | #4 50.3% | #9 57.6% | #23 0.024 |
| | 2/3 | #11 44.7% | #4 61.2% | #7 0.087 |
| | 2/3 | #7 47.2% | #10 57.3% | #31 -0.004 |
| | 1/3 | #2 50.7% | #11 57.3% | #25 0.013 |
| | 1/3 | #13 43.1% | #22 52.1% | #4 0.123 |
| | 1/3 | #5 48.0% | #35 46.2% | #36 -0.017 |
| | 1/3 | — | #5 60.8% | #15 0.040 |
| | 1/3 | — | #20 53.8% | #5 0.112 |
| | 1/3 | — | #6 59.3% | #20 0.033 |
| | 1/3 | — | #24 50.5% | #6 0.097 |
| | 1/3 | #8 46.0% | #23 51.8% | #13 0.042 |
| | 1/3 | #22 38.1% | #15 55.6% | #8 0.082 |
| | 1/3 | #9 45.8% | #33 46.8% | #21 0.030 |
| | 1/3 | — | #13 56.3% | #9 0.076 |
| | 1/3 | #10 45.4% | #12 56.6% | #33 -0.007 |
| | 1/3 | #31 34.2% | #28 47.8% | #10 0.066 |
「—」表示該榜沒有收錄這個模型,不是零分。尚未識別出具體模型的條目不在此處出現,但仍顯示在各自的原始榜單上。