Agent Reasoning

Decide what to do next: pick the right tool, plan multi-step actions, recover when something goes wrong. The hardest category — open-ended decisions, no single correct answer.

94
gcp/gemini-3-pro-preview
Average duration
16s
Average tokens
3635
Average cost
$0.02
100
8s
1727
opper_agents_sample_01
100
12s
2322
opper_agents_sample_02
100
13s
2437
opper_agents_sample_03
100
11s
2325
opper_agents_sample_04
100
11s
2551
opper_agents_sample_05
100
16s
3107
opper_agents_sample_06
100
10s
2610
opper_agents_sample_07
100
15s
3163
opper_agents_sample_08
100
9s
3876
opper_agents_sample_09
100
13s
4257
opper_agents_sample_10
100
10s
3828
opper_agents_sample_11
50
21s
3376
opper_agents_sample_12
100
12s
2424
opper_agents_sample_13
100
11s
2909
opper_agents_sample_14
100
10s
2348
opper_agents_sample_15
100
9s
2160
opper_agents_sample_16
100
30s
4509
opper_agents_sample_17
100
9s
2289
opper_agents_sample_18
100
11s
4819
opper_agents_sample_19
100
12s
4916
opper_agents_sample_20
100
20s
5963
opper_agents_sample_21
0
1m 20s
11010
opper_agents_sample_22
100
22s
6130
opper_agents_sample_23
100
6s
2187
opper_agents_sample_24