Agent Reasoning

Decide what to do next: pick the right tool, plan multi-step actions, recover when something goes wrong. The hardest category — open-ended decisions, no single correct answer.

81
nebius/nemotron-3-ultra-550b-a55b
Average duration
12s
Average tokens
2976
Average cost
$0.00
100
13s
2046
opper_agents_sample_01
100
9s
1852
opper_agents_sample_02
100
12s
2103
opper_agents_sample_03
100
9s
1919
opper_agents_sample_04
50
20s
3150
opper_agents_sample_05
100
11s
2306
opper_agents_sample_06
100
9s
2444
opper_agents_sample_07
100
9s
2401
opper_agents_sample_08
100
9s
3644
opper_agents_sample_09
100
14s
4049
opper_agents_sample_10
100
10s
3567
opper_agents_sample_11
100
10s
1999
opper_agents_sample_12
0
13s
2322
opper_agents_sample_13
100
6s
2250
opper_agents_sample_14
50
9s
2085
opper_agents_sample_15
100
6s
1494
opper_agents_sample_16
0
20s
3048
opper_agents_sample_17
100
16s
2742
opper_agents_sample_18
100
5s
3836
opper_agents_sample_19
100
6s
3990
opper_agents_sample_20
100
15s
4939
opper_agents_sample_21
50
23s
5008
opper_agents_sample_22
0
20s
5678
opper_agents_sample_23
100
10s
2547
opper_agents_sample_24