Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

79
openai/o4-mini
Average duration
20s
Average tokens
1907
Average cost
$0.00
100
18s
1097
opper_lang_sv_sv_001
100
12s
886
opper_lang_sv_sv_002
100
15s
1020
opper_lang_sv_sv_003
80
17s
866
opper_lang_sv_sv_004
80
17s
1141
opper_lang_sv_sv_005
100
18s
1166
opper_lang_sv_sv_006
80
15s
1730
opper_lang_sv_sv_007
80
16s
1752
opper_lang_sv_sv_008
100
14s
1652
opper_lang_sv_sv_009
80
56s
1827
opper_lang_sv_sv_010
100
17s
1790
opper_lang_sv_sv_011
100
14s
1439
opper_lang_sv_sv_012
60
1m 7s
1553
opper_lang_sv_sv_013
80
14s
1747
opper_lang_sv_sv_014
80
20s
2081
opper_lang_sv_sv_015
80
15s
1743
opper_lang_sv_sv_016
80
15s
1774
opper_lang_sv_sv_017
80
18s
1833
opper_lang_sv_sv_018
40
14s
1751
opper_lang_sv_sv_019
60
16s
1696
opper_lang_sv_sv_020
80
16s
1930
opper_lang_sv_sv_021
80
44s
2145
opper_lang_sv_sv_022
80
18s
2352
opper_lang_sv_sv_023
80
18s
2016
opper_lang_sv_sv_024
80
14s
1880
opper_lang_sv_sv_025
80
14s
1947
opper_lang_sv_sv_026
80
16s
2105
opper_lang_sv_sv_027
80
17s
1814
opper_lang_sv_sv_028
80
15s
1889
opper_lang_sv_sv_029
100
16s
1879
opper_lang_sv_sv_030
80
15s
2362
opper_lang_sv_sv_031
80
16s
2083
opper_lang_sv_sv_032
80
11s
1927
opper_lang_sv_sv_033
80
14s
2002
opper_lang_sv_sv_034
80
13s
2054
opper_lang_sv_sv_035
40
16s
2234
opper_lang_sv_sv_036
80
20s
2154
opper_lang_sv_sv_037
40
21s
2522
opper_lang_sv_sv_038
20
17s
1990
opper_lang_sv_sv_039
80
19s
2010
opper_lang_sv_sv_040
100
17s
2160
opper_lang_sv_sv_041
40
14s
1895
opper_lang_sv_sv_042
80
18s
2125
opper_lang_sv_sv_043
80
13s
1901
opper_lang_sv_sv_044
100
38s
2373
opper_lang_sv_sv_045
80
11s
1886
opper_lang_sv_sv_046
100
17s
2264
opper_lang_sv_sv_047
80
1m 22s
1794
opper_lang_sv_sv_048
80
21s
2805
opper_lang_sv_sv_049
80
17s
2415
opper_lang_sv_sv_050
80
17s
2754
opper_lang_sv_sv_051
80
16s
2934
opper_lang_sv_sv_052