Agent Reasoning

Decide what to do next: pick the right tool, plan multi-step actions, recover when something goes wrong. The hardest category — open-ended decisions, no single correct answer.

79
novita/qwen3.5-397b-a17b
Average duration
22s
Average tokens
2995
Average cost
$0.00
100
7s
1496
opper_agents_sample_01
100
10s
1796
opper_agents_sample_02
50
8s
1672
opper_agents_sample_03
100
9s
1978
opper_agents_sample_04
100
8s
2016
opper_agents_sample_05
100
2m 18s
3882
opper_agents_sample_06
100
10s
2289
opper_agents_sample_07
100
8s
2226
opper_agents_sample_08
100
13s
3803
opper_agents_sample_09
100
12s
3570
opper_agents_sample_10
100
13s
3501
opper_agents_sample_11
100
1m 6s
2271
opper_agents_sample_12
0
9s
1799
opper_agents_sample_13
100
5s
2104
opper_agents_sample_14
50
11s
2116
opper_agents_sample_15
100
10s
1912
opper_agents_sample_16
0
1m 2s
6334
opper_agents_sample_17
100
26s
2322
opper_agents_sample_18
100
7s
3899
opper_agents_sample_19
100
6s
3822
opper_agents_sample_20
50
53s
7070
opper_agents_sample_21
50
16s
3603
opper_agents_sample_22
0
12s
4431
opper_agents_sample_23
100
7s
1964
opper_agents_sample_24