Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

79
fireworks/deepseek-r1
Average duration
12s
Average tokens
1792
Average cost
$0.00
80
17s
1551
opper_lang_sv_sv_001
100
8s
895
opper_lang_sv_sv_002
100
8s
951
opper_lang_sv_sv_003
100
9s
902
opper_lang_sv_sv_004
80
9s
953
opper_lang_sv_sv_005
80
10s
1079
opper_lang_sv_sv_006
80
14s
1987
opper_lang_sv_sv_007
80
11s
1763
opper_lang_sv_sv_008
80
10s
1712
opper_lang_sv_sv_009
80
18s
2343
opper_lang_sv_sv_010
100
10s
1581
opper_lang_sv_sv_011
80
11s
1850
opper_lang_sv_sv_012
40
12s
1528
opper_lang_sv_sv_013
80
9s
1718
opper_lang_sv_sv_014
100
20s
1727
opper_lang_sv_sv_015
80
12s
1829
opper_lang_sv_sv_016
80
13s
1698
opper_lang_sv_sv_017
80
7s
1599
opper_lang_sv_sv_018
60
11s
1788
opper_lang_sv_sv_019
80
8s
1630
opper_lang_sv_sv_020
80
12s
1947
opper_lang_sv_sv_021
80
10s
1778
opper_lang_sv_sv_022
80
13s
1927
opper_lang_sv_sv_023
80
10s
1844
opper_lang_sv_sv_024
80
12s
1899
opper_lang_sv_sv_025
80
8s
1892
opper_lang_sv_sv_026
100
11s
1897
opper_lang_sv_sv_027
80
8s
1686
opper_lang_sv_sv_028
100
11s
1836
opper_lang_sv_sv_029
80
12s
1783
opper_lang_sv_sv_030
60
13s
1983
opper_lang_sv_sv_031
80
13s
2004
opper_lang_sv_sv_032
80
12s
1783
opper_lang_sv_sv_033
80
17s
2091
opper_lang_sv_sv_034
80
12s
1809
opper_lang_sv_sv_035
40
10s
1945
opper_lang_sv_sv_036
40
14s
1776
opper_lang_sv_sv_037
60
12s
1826
opper_lang_sv_sv_038
100
16s
2073
opper_lang_sv_sv_039
50
14s
1952
opper_lang_sv_sv_040
80
15s
1749
opper_lang_sv_sv_041
60
14s
1828
opper_lang_sv_sv_042
80
12s
2005
opper_lang_sv_sv_043
80
13s
1908
opper_lang_sv_sv_044
80
10s
1877
opper_lang_sv_sv_045
80
12s
1813
opper_lang_sv_sv_046
100
12s
1724
opper_lang_sv_sv_047
80
11s
1891
opper_lang_sv_sv_048
80
13s
2105
opper_lang_sv_sv_049
80
23s
2062
opper_lang_sv_sv_050
80
16s
2720
opper_lang_sv_sv_051
80
13s
2672
opper_lang_sv_sv_052