Agent Reasoning

Decide what to do next: pick the right tool, plan multi-step actions, recover when something goes wrong. The hardest category — open-ended decisions, no single correct answer.

77
xai/grok-4-1-fast-non-reasoning
Average duration
8s
Average tokens
2426
Average cost
$0.00
100
6s
1419
opper_agents_sample_01
100
6s
1563
opper_agents_sample_02
100
6s
1590
opper_agents_sample_03
100
9s
1902
opper_agents_sample_04
100
5s
1808
opper_agents_sample_05
100
11s
2136
opper_agents_sample_06
100
6s
2079
opper_agents_sample_07
100
11s
2334
opper_agents_sample_08
100
8s
3197
opper_agents_sample_09
100
10s
3281
opper_agents_sample_10
100
11s
3170
opper_agents_sample_11
100
9s
1845
opper_agents_sample_12
0
15s
2193
opper_agents_sample_13
100
4s
2026
opper_agents_sample_14
100
5s
1695
opper_agents_sample_15
100
6s
1566
opper_agents_sample_16
0
8s
1834
opper_agents_sample_17
50
10s
1968
opper_agents_sample_18
100
10s
3779
opper_agents_sample_19
100
6s
3865
opper_agents_sample_20
100
8s
3995
opper_agents_sample_21
0
6s
2887
opper_agents_sample_22
0
8s
4158
opper_agents_sample_23
0
8s
1944
opper_agents_sample_24