Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

65
mistral/pixtral-large-latest-eu
Average duration
10s
Average tokens
1711
Average cost
$0.00
60
5s
789
opper_lang_sv_sv_001
80
6s
796
opper_lang_sv_sv_002
100
4s
753
opper_lang_sv_sv_003
80
4s
693
opper_lang_sv_sv_004
80
36s
884
opper_lang_sv_sv_005
100
35s
801
opper_lang_sv_sv_006
80
5s
1826
opper_lang_sv_sv_007
40
6s
1815
opper_lang_sv_sv_008
80
6s
1839
opper_lang_sv_sv_009
80
6s
1817
opper_lang_sv_sv_010
80
5s
1527
opper_lang_sv_sv_011
80
6s
1543
opper_lang_sv_sv_012
40
4s
1494
opper_lang_sv_sv_013
80
8s
1756
opper_lang_sv_sv_014
50
8s
1709
opper_lang_sv_sv_015
40
7s
1722
opper_lang_sv_sv_016
80
38s
1640
opper_lang_sv_sv_017
80
5s
1534
opper_lang_sv_sv_018
40
5s
1625
opper_lang_sv_sv_019
60
6s
1554
opper_lang_sv_sv_020
80
6s
1899
opper_lang_sv_sv_021
60
7s
1818
opper_lang_sv_sv_022
50
7s
1975
opper_lang_sv_sv_023
60
7s
1934
opper_lang_sv_sv_024
80
6s
1875
opper_lang_sv_sv_025
60
7s
1871
opper_lang_sv_sv_026
80
7s
1896
opper_lang_sv_sv_027
50
8s
1782
opper_lang_sv_sv_028
80
6s
1826
opper_lang_sv_sv_029
40
5s
1650
opper_lang_sv_sv_030
60
10s
1834
opper_lang_sv_sv_031
50
7s
1831
opper_lang_sv_sv_032
80
6s
1840
opper_lang_sv_sv_033
80
7s
1971
opper_lang_sv_sv_034
80
8s
1804
opper_lang_sv_sv_035
40
8s
2094
opper_lang_sv_sv_036
60
7s
1744
opper_lang_sv_sv_037
60
7s
1789
opper_lang_sv_sv_038
40
1m 11s
1741
opper_lang_sv_sv_039
50
7s
1817
opper_lang_sv_sv_040
100
7s
1866
opper_lang_sv_sv_041
40
9s
1819
opper_lang_sv_sv_042
50
7s
1773
opper_lang_sv_sv_043
80
6s
1686
opper_lang_sv_sv_044
80
8s
1901
opper_lang_sv_sv_045
40
8s
1817
opper_lang_sv_sv_046
40
5s
1755
opper_lang_sv_sv_047
40
5s
1669
opper_lang_sv_sv_048
80
8s
2012
opper_lang_sv_sv_049
80
11s
1997
opper_lang_sv_sv_050
80
13s
2857
opper_lang_sv_sv_051
40
9s
2688
opper_lang_sv_sv_052