Agent Reasoning

Decide what to do next: pick the right tool, plan multi-step actions, recover when something goes wrong. The hardest category — open-ended decisions, no single correct answer.

98
gcp/gemini-3.1-pro-preview
Average duration
19s
Average tokens
2604
Average cost
$0.01
100
23s
1531
opper_agents_sample_01
100
11s
1752
opper_agents_sample_02
100
19s
1631
opper_agents_sample_03
100
28s
1878
opper_agents_sample_04
100
51s
2067
opper_agents_sample_05
100
12s
2250
opper_agents_sample_06
100
7s
2062
opper_agents_sample_07
100
12s
2335
opper_agents_sample_08
100
22s
3572
opper_agents_sample_09
100
8s
3422
opper_agents_sample_10
100
10s
3539
opper_agents_sample_11
100
19s
1817
opper_agents_sample_12
100
9s
1842
opper_agents_sample_13
100
6s
2173
opper_agents_sample_14
100
20s
1685
opper_agents_sample_15
100
17s
1761
opper_agents_sample_16
100
1m 3s
2086
opper_agents_sample_17
100
10s
1770
opper_agents_sample_18
100
16s
4165
opper_agents_sample_19
100
6s
3999
opper_agents_sample_20
100
23s
4818
opper_agents_sample_21
50
37s
3648
opper_agents_sample_22
100
17s
4642
opper_agents_sample_23
100
10s
2049
opper_agents_sample_24