Agent Reasoning

Decide what to do next: pick the right tool, plan multi-step actions, recover when something goes wrong. The hardest category — open-ended decisions, no single correct answer.

79
xai/grok-4.20-non-reasoning
Average duration
5s
Average tokens
2301
Average cost
$0.01
100
4s
1319
opper_agents_sample_01
100
5s
1520
opper_agents_sample_02
100
10s
1591
opper_agents_sample_03
100
4s
1643
opper_agents_sample_04
100
2s
1591
opper_agents_sample_05
100
8s
2024
opper_agents_sample_06
100
3s
1876
opper_agents_sample_07
50
4s
1999
opper_agents_sample_08
100
4s
3044
opper_agents_sample_09
100
4s
2990
opper_agents_sample_10
100
5s
3002
opper_agents_sample_11
50
8s
1783
opper_agents_sample_12
100
5s
1579
opper_agents_sample_13
100
3s
1966
opper_agents_sample_14
100
4s
1627
opper_agents_sample_15
100
4s
1503
opper_agents_sample_16
0
4s
1717
opper_agents_sample_17
100
5s
1756
opper_agents_sample_18
100
4s
3710
opper_agents_sample_19
100
4s
3768
opper_agents_sample_20
100
6s
3939
opper_agents_sample_21
0
13s
3456
opper_agents_sample_22
0
5s
3954
opper_agents_sample_23
0
4s
1866
opper_agents_sample_24