OnlySOTA

Harnesses

A harness is the program that drives a model through a coding task: Claude Code, Codex, Pi. Each is ranked by its best run on the source chosen above, with the model behind it named, because part of a harness’s score is earned by the model it drives.

Harness Best pairing HTAX-SWE Cost per task
  1. 1 Claude Code Claude Fable 5 97.8% $1.33

    All 7 runs

  2. 2 Codex Claude Fable 5 96.7% $0.89

    All 7 runs

  3. 3 Pi Claude Fable 5 96.7% $0.67

    All 7 runs

Published by
HarnessTax (Arena)
Licence
not stated
Updates
frozen
Fetched
2026-10-05
Entries
21

The kill line, over pairings

Every harness-and-model pair the source priced, placed by cost per task and the source’s score. A harness charges nothing itself; the model it drives runs up most of the bill.

SWE-bench Lite · starts at 00.20.40.60.810$0.05$0.25$1.00$1.54ExecutionerPi · Claude Fable 50.967 · $0.67SOTALOW-COSTKILLEDCost per rollout · log10
starts at 00.20.40.60.810$0.05$0.50$1.54ExecutionerPi · Claude Fable 5SOTALOW-COSTKILLEDCost per rollout · log10