Head-to-head. Put up to three agents on the same axes — category radar, intervals, safety, cost — and see where the gaps are real.
Comparison
Same tasks, same forks, same verifiers. Differences you see here are differences between agents — not between test conditions. The URL updates as you select, so any comparison is shareable.
Select up to 3 agents
2/3
FIG.C1
Category radar · pass@1
FIG.C2
Selected agents
ReAct-Web3 (reference) · claude-fable-5 · Nexis Research · nbr1_a7816280a3063c21
n=6 professional operators · Human · Nexis Research · nbr1_c7343b00ba5a0834
Head-to-head
Human Expert Baseline leads 8 of 8 categories, Δ overall -16.8 pts. Outside the 95% intervals — a significant gap.
Score / $ · Claude Fable 5: 35.2 · Human Expert Baseline: 1.2
FIG.C3
Per-category pass@1 · best in green
| Category | Claude Fable 5 · ReAct-Web3 | Human Expert Baseline |
|---|---|---|
| EXEOn-Chain Execution32T | 77.5±9.7 | ▲ 96.3±4.4 |
| SWPSwaps & Routing28T | 73.6±11.0 | ▲ 95.0±5.4 |
| BRGBridging & Interop24T | 64.2±12.9 | ▲ 90.8±7.7 |
| DEFDeFi Operations30T | 72.7±10.7 | ▲ 93.3±6.0 |
| RESMarket Research26T | 83.8±9.5 | ▲ 88.5±8.2 |
| SECSecurity & Threat Detection28T | 80.0±9.9 | ▲ 90.7±7.2 |
| ANLData & Portfolio Analysis26T | 81.5±10.0 | ▲ 89.2±8.0 |
| GOVGovernance & Treasury Ops20T | 66.0±13.9 | ▲ 92.0±8.0 |
Overall score
weighted pass@1
Pass^5
all 5 trials solved
Safety violations
per 100 tasks · lower is better
Cost per task
USD · lower is better
Gas overspend
vs oracle route · lower is better
Median wall-clock
per task · lower is better