Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

53
mistral/mistral-small-eu
Average duration
9s
Average tokens
1730
Average cost
$0.00
80
8s
867
opper_lang_sv_sv_001
80
4s
772
opper_lang_sv_sv_002
80
43s
789
opper_lang_sv_sv_003
100
2s
705
opper_lang_sv_sv_004
40
4s
837
opper_lang_sv_sv_005
80
3s
768
opper_lang_sv_sv_006
40
8s
1789
opper_lang_sv_sv_007
80
8s
2023
opper_lang_sv_sv_008
80
5s
1724
opper_lang_sv_sv_009
40
7s
1919
opper_lang_sv_sv_010
80
4s
1585
opper_lang_sv_sv_011
60
4s
1513
opper_lang_sv_sv_012
40
4s
1485
opper_lang_sv_sv_013
80
7s
1672
opper_lang_sv_sv_014
50
5s
1693
opper_lang_sv_sv_015
20
6s
1770
opper_lang_sv_sv_016
80
10s
1763
opper_lang_sv_sv_017
80
7s
1608
opper_lang_sv_sv_018
40
6s
1648
opper_lang_sv_sv_019
20
8s
1786
opper_lang_sv_sv_020
60
15s
2137
opper_lang_sv_sv_021
50
8s
1754
opper_lang_sv_sv_022
80
10s
2032
opper_lang_sv_sv_023
40
6s
1936
opper_lang_sv_sv_024
40
6s
1816
opper_lang_sv_sv_025
80
8s
1918
opper_lang_sv_sv_026
100
6s
1738
opper_lang_sv_sv_027
60
4s
1705
opper_lang_sv_sv_028
80
9s
1881
opper_lang_sv_sv_029
40
7s
1735
opper_lang_sv_sv_030
20
9s
1914
opper_lang_sv_sv_031
60
6s
1734
opper_lang_sv_sv_032
60
9s
1980
opper_lang_sv_sv_033
50
6s
1934
opper_lang_sv_sv_034
50
11s
1977
opper_lang_sv_sv_035
40
9s
2009
opper_lang_sv_sv_036
60
7s
1811
opper_lang_sv_sv_037
20
9s
1729
opper_lang_sv_sv_038
0
8s
1893
opper_lang_sv_sv_039
50
8s
1824
opper_lang_sv_sv_040
50
10s
1920
opper_lang_sv_sv_041
0
8s
1787
opper_lang_sv_sv_042
50
8s
1795
opper_lang_sv_sv_043
50
12s
1710
opper_lang_sv_sv_044
40
11s
1993
opper_lang_sv_sv_045
40
39s
1864
opper_lang_sv_sv_046
20
4s
1739
opper_lang_sv_sv_047
40
6s
1606
opper_lang_sv_sv_048
60
6s
1956
opper_lang_sv_sv_049
40
11s
1954
opper_lang_sv_sv_050
40
10s
2735
opper_lang_sv_sv_051
20
6s
2730
opper_lang_sv_sv_052