Agent Reasoning

Decide what to do next: pick the right tool, plan multi-step actions, recover when something goes wrong. The hardest category — open-ended decisions, no single correct answer.

94
vertexai/gemini-3.5-flash
Average duration
5s
Average tokens
2890
Average cost
$0.01
100
4s
1584
opper_agents_sample_01
100
4s
1633
opper_agents_sample_02
100
5s
2055
opper_agents_sample_03
100
4s
1958
opper_agents_sample_04
100
4s
2079
opper_agents_sample_05
50
5s
2309
opper_agents_sample_06
100
5s
2509
opper_agents_sample_07
100
7s
3027
opper_agents_sample_08
100
5s
3976
opper_agents_sample_09
100
4s
3728
opper_agents_sample_10
100
3s
3260
opper_agents_sample_11
50
3s
1659
opper_agents_sample_12
100
3s
1606
opper_agents_sample_13
100
5s
2741
opper_agents_sample_14
100
5s
2359
opper_agents_sample_15
100
3s
1705
opper_agents_sample_16
100
5s
2285
opper_agents_sample_17
100
4s
2030
opper_agents_sample_18
100
4s
4394
opper_agents_sample_19
100
3s
4098
opper_agents_sample_20
100
8s
5305
opper_agents_sample_21
50
7s
3886
opper_agents_sample_22
100
15s
6560
opper_agents_sample_23
100
5s
2622
opper_agents_sample_24