Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

69
openai/o1-mini
Average duration
17s
Average tokens
2166
Average cost
$0.00
80
16s
1673
opper_lang_sv_sv_001
100
12s
1612
opper_lang_sv_sv_002
80
7s
1098
opper_lang_sv_sv_003
100
7s
1012
opper_lang_sv_sv_004
80
12s
1519
opper_lang_sv_sv_005
80
1m 21s
1531
opper_lang_sv_sv_006
80
11s
2372
opper_lang_sv_sv_007
80
1m 7s
2948
opper_lang_sv_sv_008
80
11s
2260
opper_lang_sv_sv_009
80
13s
2694
opper_lang_sv_sv_010
100
10s
2014
opper_lang_sv_sv_011
80
10s
1930
opper_lang_sv_sv_012
60
9s
1832
opper_lang_sv_sv_013
80
9s
1933
opper_lang_sv_sv_014
40
18s
2441
opper_lang_sv_sv_015
40
10s
2222
opper_lang_sv_sv_016
80
13s
2556
opper_lang_sv_sv_017
80
40s
1810
opper_lang_sv_sv_018
40
10s
2048
opper_lang_sv_sv_019
80
12s
2272
opper_lang_sv_sv_020
80
13s
2721
opper_lang_sv_sv_021
80
10s
2214
opper_lang_sv_sv_022
50
34s
2092
opper_lang_sv_sv_023
80
8s
2086
opper_lang_sv_sv_024
80
9s
2083
opper_lang_sv_sv_025
80
11s
2379
opper_lang_sv_sv_026
80
44s
2286
opper_lang_sv_sv_027
80
12s
2336
opper_lang_sv_sv_028
80
14s
2932
opper_lang_sv_sv_029
80
14s
2021
opper_lang_sv_sv_030
80
9s
2251
opper_lang_sv_sv_031
80
7s
1900
opper_lang_sv_sv_032
80
10s
2317
opper_lang_sv_sv_033
50
7s
1885
opper_lang_sv_sv_034
80
10s
2122
opper_lang_sv_sv_035
40
9s
2399
opper_lang_sv_sv_036
60
9s
2176
opper_lang_sv_sv_037
40
55s
2061
opper_lang_sv_sv_038
50
10s
2203
opper_lang_sv_sv_039
40
20s
2122
opper_lang_sv_sv_040
40
52s
2563
opper_lang_sv_sv_041
20
9s
2266
opper_lang_sv_sv_042
60
7s
1896
opper_lang_sv_sv_043
80
9s
2194
opper_lang_sv_sv_044
40
13s
3100
opper_lang_sv_sv_045
80
37s
2054
opper_lang_sv_sv_046
80
10s
1848
opper_lang_sv_sv_047
40
17s
3032
opper_lang_sv_sv_048
80
7s
2137
opper_lang_sv_sv_049
40
8s
2240
opper_lang_sv_sv_050
80
7s
2527
opper_lang_sv_sv_051
50
7s
2429
opper_lang_sv_sv_052