Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

45
mistral/mistral-tiny-eu
Average duration
16s
Average tokens
2161
Average cost
$0.00
80
43s
918
opper_lang_sv_sv_001
80
3s
836
opper_lang_sv_sv_002
100
4s
754
opper_lang_sv_sv_003
100
2s
681
opper_lang_sv_sv_004
40
5s
870
opper_lang_sv_sv_005
100
18s
780
opper_lang_sv_sv_006
0
19s
4363
opper_lang_sv_sv_007
40
37s
5095
opper_lang_sv_sv_008
0
14s
4377
opper_lang_sv_sv_009
20
38s
1848
opper_lang_sv_sv_010
80
17s
5164
opper_lang_sv_sv_011
60
4s
1560
opper_lang_sv_sv_012
60
15s
1511
opper_lang_sv_sv_013
60
5s
1725
opper_lang_sv_sv_014
40
5s
1664
opper_lang_sv_sv_015
20
4s
1669
opper_lang_sv_sv_016
40
6s
1668
opper_lang_sv_sv_017
60
4s
1557
opper_lang_sv_sv_018
20
39s
1481
opper_lang_sv_sv_019
20
3s
1558
opper_lang_sv_sv_020
40
8s
1890
opper_lang_sv_sv_021
20
4s
1855
opper_lang_sv_sv_022
20
4s
1939
opper_lang_sv_sv_023
0
26s
1904
opper_lang_sv_sv_024
40
5s
1884
opper_lang_sv_sv_025
50
7s
1907
opper_lang_sv_sv_026
80
9s
1911
opper_lang_sv_sv_027
50
28s
1900
opper_lang_sv_sv_028
80
9s
1855
opper_lang_sv_sv_029
60
21s
1698
opper_lang_sv_sv_030
40
21s
4466
opper_lang_sv_sv_031
60
4s
1752
opper_lang_sv_sv_032
60
5s
1858
opper_lang_sv_sv_033
40
26s
1847
opper_lang_sv_sv_034
60
5s
1782
opper_lang_sv_sv_035
40
6s
2019
opper_lang_sv_sv_036
40
12s
1798
opper_lang_sv_sv_037
20
34s
1757
opper_lang_sv_sv_038
40
26s
3049
opper_lang_sv_sv_039
60
4s
1790
opper_lang_sv_sv_040
40
39s
3983
opper_lang_sv_sv_041
40
49s
1873
opper_lang_sv_sv_042
20
5s
1621
opper_lang_sv_sv_043
40
24s
5655
opper_lang_sv_sv_044
40
10s
2455
opper_lang_sv_sv_045
20
23s
1803
opper_lang_sv_sv_046
20
31s
1850
opper_lang_sv_sv_047
0
27s
2828
opper_lang_sv_sv_048
60
5s
1960
opper_lang_sv_sv_049
20
20s
1986
opper_lang_sv_sv_050
60
5s
2634
opper_lang_sv_sv_051
40
1m 6s
2774
opper_lang_sv_sv_052