Agent Reasoning

Decide what to do next: pick the right tool, plan multi-step actions, recover when something goes wrong. The hardest category — open-ended decisions, no single correct answer.

98
anthropic/claude-opus-4-8
Average duration
12s
Average tokens
789
Average cost
$0.04
100
4s
187
opper_agents_sample_01
100
10s
719
opper_agents_sample_02
100
9s
511
opper_agents_sample_03
100
10s
684
opper_agents_sample_04
100
10s
527
opper_agents_sample_05
100
12s
879
opper_agents_sample_06
100
8s
488
opper_agents_sample_07
100
13s
885
opper_agents_sample_08
100
18s
1375
opper_agents_sample_09
100
11s
680
opper_agents_sample_10
100
24s
1811
opper_agents_sample_11
100
10s
635
opper_agents_sample_12
100
14s
932
opper_agents_sample_13
100
5s
320
opper_agents_sample_14
50
10s
730
opper_agents_sample_15
100
10s
801
opper_agents_sample_16
100
11s
595
opper_agents_sample_17
100
11s
753
opper_agents_sample_18
100
5s
267
opper_agents_sample_19
100
6s
368
opper_agents_sample_20
100
17s
1469
opper_agents_sample_21
100
22s
1785
opper_agents_sample_22
100
29s
1355
opper_agents_sample_23
100
5s
181
opper_agents_sample_24