Agent Reasoning

Decide what to do next: pick the right tool, plan multi-step actions, recover when something goes wrong. The hardest category — open-ended decisions, no single correct answer.

90
novita/deepseek-v4-pro
Average duration
43s
Average tokens
3001
Average cost
$0.01
100
39s
1894
opper_agents_sample_01
100
20s
1835
opper_agents_sample_02
100
29s
2191
opper_agents_sample_03
100
29s
2030
opper_agents_sample_04
100
32s
2526
opper_agents_sample_05
100
30s
2381
opper_agents_sample_06
100
13s
2202
opper_agents_sample_07
100
32s
2801
opper_agents_sample_08
100
4m 57s
3480
opper_agents_sample_09
100
23s
3567
opper_agents_sample_10
100
40s
4016
opper_agents_sample_11
100
18s
1908
opper_agents_sample_12
100
27s
2305
opper_agents_sample_13
100
11s
2148
opper_agents_sample_14
100
22s
2045
opper_agents_sample_15
100
22s
1910
opper_agents_sample_16
0
37s
1869
opper_agents_sample_17
100
56s
2489
opper_agents_sample_18
100
24s
4200
opper_agents_sample_19
100
17s
4269
opper_agents_sample_20
100
1m 30s
6858
opper_agents_sample_21
50
1m 4s
5577
opper_agents_sample_22
0
25s
4595
opper_agents_sample_23
100
39s
2931
opper_agents_sample_24