Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

84
mistral/mistral-medium-2508-eu
Average duration
22s
Average tokens
2122
Average cost
$0.00
80
10s
930
opper_lang_sv_sv_001
80
13s
872
opper_lang_sv_sv_002
100
7s
766
opper_lang_sv_sv_003
100
5s
694
opper_lang_sv_sv_004
80
11s
885
opper_lang_sv_sv_005
80
6s
748
opper_lang_sv_sv_006
80
22s
2164
opper_lang_sv_sv_007
100
18s
2237
opper_lang_sv_sv_008
100
8s
1611
opper_lang_sv_sv_009
100
21s
2057
opper_lang_sv_sv_010
100
12s
1592
opper_lang_sv_sv_011
100
12s
1501
opper_lang_sv_sv_012
80
10s
1454
opper_lang_sv_sv_013
100
16s
2150
opper_lang_sv_sv_014
80
9s
1624
opper_lang_sv_sv_015
80
35s
3148
opper_lang_sv_sv_016
100
21s
2063
opper_lang_sv_sv_017
80
11s
1590
opper_lang_sv_sv_018
60
24s
2444
opper_lang_sv_sv_019
80
13s
1861
opper_lang_sv_sv_020
80
13s
2125
opper_lang_sv_sv_021
100
26s
2692
opper_lang_sv_sv_022
80
19s
2117
opper_lang_sv_sv_023
80
11s
2150
opper_lang_sv_sv_024
80
26s
2764
opper_lang_sv_sv_025
80
22s
2321
opper_lang_sv_sv_026
80
15s
2002
opper_lang_sv_sv_027
80
21s
2131
opper_lang_sv_sv_028
100
11s
2034
opper_lang_sv_sv_029
80
21s
2018
opper_lang_sv_sv_030
100
40s
2719
opper_lang_sv_sv_031
80
24s
2383
opper_lang_sv_sv_032
80
11s
1728
opper_lang_sv_sv_033
100
15s
2076
opper_lang_sv_sv_034
100
24s
2104
opper_lang_sv_sv_035
60
58s
3462
opper_lang_sv_sv_036
80
40s
2541
opper_lang_sv_sv_037
40
17s
1906
opper_lang_sv_sv_038
80
36s
4056
opper_lang_sv_sv_039
80
50s
2542
opper_lang_sv_sv_040
100
20s
2029
opper_lang_sv_sv_041
80
32s
2416
opper_lang_sv_sv_042
80
36s
2466
opper_lang_sv_sv_043
80
19s
1818
opper_lang_sv_sv_044
50
56s
3266
opper_lang_sv_sv_045
80
30s
2207
opper_lang_sv_sv_046
40
17s
1844
opper_lang_sv_sv_047
80
47s
3038
opper_lang_sv_sv_048
100
20s
2117
opper_lang_sv_sv_049
100
21s
2203
opper_lang_sv_sv_050
100
39s
3543
opper_lang_sv_sv_051
80
29s
3148
opper_lang_sv_sv_052