Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

79
openai/o1
Average duration
21s
Average tokens
1991
Average cost
$0.00
80
13s
1369
opper_lang_sv_sv_001
100
8s
947
opper_lang_sv_sv_002
100
8s
1069
opper_lang_sv_sv_003
100
8s
993
opper_lang_sv_sv_004
80
10s
1204
opper_lang_sv_sv_005
100
10s
1301
opper_lang_sv_sv_006
80
16s
2162
opper_lang_sv_sv_007
80
13s
2387
opper_lang_sv_sv_008
100
12s
1760
opper_lang_sv_sv_009
80
11s
1865
opper_lang_sv_sv_010
100
9s
1462
opper_lang_sv_sv_011
80
11s
1684
opper_lang_sv_sv_012
80
11s
1679
opper_lang_sv_sv_013
80
11s
1941
opper_lang_sv_sv_014
80
11s
1786
opper_lang_sv_sv_015
80
1m 33s
2378
opper_lang_sv_sv_016
80
11s
1747
opper_lang_sv_sv_017
100
34s
1872
opper_lang_sv_sv_018
60
24s
2077
opper_lang_sv_sv_019
80
12s
1982
opper_lang_sv_sv_020
80
1m 19s
2401
opper_lang_sv_sv_021
60
11s
1843
opper_lang_sv_sv_022
80
10s
2062
opper_lang_sv_sv_023
80
13s
2114
opper_lang_sv_sv_024
80
12s
2046
opper_lang_sv_sv_025
100
1m 22s
1811
opper_lang_sv_sv_026
80
1m 10s
1959
opper_lang_sv_sv_027
80
28s
2073
opper_lang_sv_sv_028
80
14s
2229
opper_lang_sv_sv_029
80
10s
1688
opper_lang_sv_sv_030
80
7s
1757
opper_lang_sv_sv_031
50
11s
2251
opper_lang_sv_sv_032
80
10s
2300
opper_lang_sv_sv_033
80
10s
2011
opper_lang_sv_sv_034
80
1m 39s
2155
opper_lang_sv_sv_035
80
14s
2761
opper_lang_sv_sv_036
80
12s
2089
opper_lang_sv_sv_037
60
23s
3474
opper_lang_sv_sv_038
50
21s
2133
opper_lang_sv_sv_039
50
1m 15s
2374
opper_lang_sv_sv_040
80
10s
1847
opper_lang_sv_sv_041
40
12s
2239
opper_lang_sv_sv_042
80
12s
1987
opper_lang_sv_sv_043
80
9s
1828
opper_lang_sv_sv_044
80
12s
1943
opper_lang_sv_sv_045
80
11s
2240
opper_lang_sv_sv_046
80
12s
2186
opper_lang_sv_sv_047
60
17s
2138
opper_lang_sv_sv_048
80
12s
1929
opper_lang_sv_sv_049
80
10s
2259
opper_lang_sv_sv_050
80
10s
2725
opper_lang_sv_sv_051
60
24s
2990
opper_lang_sv_sv_052