Agent Reasoning

Decide what to do next: pick the right tool, plan multi-step actions, recover when something goes wrong. The hardest category — open-ended decisions, no single correct answer.

92
novita/deepseek-v4-flash
Average duration
10s
Average tokens
2702
Average cost
$0.00
100
7s
1463
opper_agents_sample_01
100
8s
1619
opper_agents_sample_02
100
6s
1951
opper_agents_sample_03
100
4s
1628
opper_agents_sample_04
100
4s
1925
opper_agents_sample_05
100
4s
1909
opper_agents_sample_06
100
5s
2166
opper_agents_sample_07
100
9s
2221
opper_agents_sample_08
100
7s
3278
opper_agents_sample_09
100
7s
3645
opper_agents_sample_10
100
11s
3401
opper_agents_sample_11
50
13s
2053
opper_agents_sample_12
100
6s
2003
opper_agents_sample_13
100
8s
2204
opper_agents_sample_14
100
6s
1620
opper_agents_sample_15
100
6s
1538
opper_agents_sample_16
0
11s
2886
opper_agents_sample_17
100
5s
1943
opper_agents_sample_18
100
6s
3899
opper_agents_sample_19
100
6s
3905
opper_agents_sample_20
100
19s
4924
opper_agents_sample_21
50
44s
5931
opper_agents_sample_22
100
15s
4764
opper_agents_sample_23
100
13s
1978
opper_agents_sample_24