Agent Reasoning

Decide what to do next: pick the right tool, plan multi-step actions, recover when something goes wrong. The hardest category — open-ended decisions, no single correct answer.

94
xai/grok-4.20-reasoning
Average duration
17s
Average tokens
3556
Average cost
$0.01
100
14s
2454
opper_agents_sample_01
100
9s
2027
opper_agents_sample_02
100
16s
2769
opper_agents_sample_03
100
12s
2515
opper_agents_sample_04
100
12s
2721
opper_agents_sample_05
100
13s
2728
opper_agents_sample_06
100
11s
2846
opper_agents_sample_07
100
14s
3061
opper_agents_sample_08
100
13s
4046
opper_agents_sample_09
100
15s
3815
opper_agents_sample_10
100
12s
3786
opper_agents_sample_11
100
15s
2652
opper_agents_sample_12
100
15s
2660
opper_agents_sample_13
100
9s
2609
opper_agents_sample_14
100
15s
2649
opper_agents_sample_15
100
11s
2238
opper_agents_sample_16
100
35s
4762
opper_agents_sample_17
100
17s
3032
opper_agents_sample_18
100
16s
5065
opper_agents_sample_19
100
15s
4843
opper_agents_sample_20
100
25s
5837
opper_agents_sample_21
0
51s
7186
opper_agents_sample_22
50
36s
6803
opper_agents_sample_23
100
7s
2229
opper_agents_sample_24