Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

84
mistral/mistral-medium-2508-eu
Average duration
21696.703
Average tokens
2122
Average cost
$0
80
9867.241624975577
930
opper_lang_sv_sv_001
80
12872.090083896182
872
opper_lang_sv_sv_002
100
6891.124290996231
766
opper_lang_sv_sv_003
100
4667.943165986799
694
opper_lang_sv_sv_004
80
10849.731000023894
885
opper_lang_sv_sv_005
80
5122.841417090967
748
opper_lang_sv_sv_006
80
21930.697291973047
2164
opper_lang_sv_sv_007
100
17695.001957938075
2237
opper_lang_sv_sv_008
100
7365.269875037484
1611
opper_lang_sv_sv_009
100
20894.741959054954
2057
opper_lang_sv_sv_010
100
11631.33766700048
1592
opper_lang_sv_sv_011
100
11927.439999999478
1501
opper_lang_sv_sv_012
80
9925.420958083123
1454
opper_lang_sv_sv_013
100
15790.835749940015
2150
opper_lang_sv_sv_014
80
8783.184875035658
1624
opper_lang_sv_sv_015
80
34968.82520895451
3148
opper_lang_sv_sv_016
100
20131.099374964833
2063
opper_lang_sv_sv_017
80
10418.100415961817
1590
opper_lang_sv_sv_018
60
23452.720333007164
2444
opper_lang_sv_sv_019
80
12932.1229159832
1861
opper_lang_sv_sv_020
80
12186.827791039832
2125
opper_lang_sv_sv_021
100
25328.108957968652
2692
opper_lang_sv_sv_022
80
18484.665625030175
2117
opper_lang_sv_sv_023
80
10861.877458984964
2150
opper_lang_sv_sv_024
80
25385.581790935248
2764
opper_lang_sv_sv_025
80
21024.670290993527
2321
opper_lang_sv_sv_026
80
14371.249874937348
2002
opper_lang_sv_sv_027
80
20513.022458995692
2131
opper_lang_sv_sv_028
100
10736.689124954864
2034
opper_lang_sv_sv_029
80
20211.06983302161
2018
opper_lang_sv_sv_030
100
39660.06050002761
2719
opper_lang_sv_sv_031
80
23678.738375077955
2383
opper_lang_sv_sv_032
80
10781.046709045768
1728
opper_lang_sv_sv_033
100
14618.541166069917
2076
opper_lang_sv_sv_034
100
23940.401959000155
2104
opper_lang_sv_sv_035
60
57065.88637502864
3462
opper_lang_sv_sv_036
80
39390.813958016224
2541
opper_lang_sv_sv_037
40
16185.292916023172
1906
opper_lang_sv_sv_038
80
35371.42179196235
4056
opper_lang_sv_sv_039
80
49425.75950000901
2542
opper_lang_sv_sv_040
100
19021.262750029564
2029
opper_lang_sv_sv_041
80
31965.07220901549
2416
opper_lang_sv_sv_042
80
35628.2092500478
2466
opper_lang_sv_sv_043
80
18815.74616592843
1818
opper_lang_sv_sv_044
50
55423.66004106589
3266
opper_lang_sv_sv_045
80
29727.521917084232
2207
opper_lang_sv_sv_046
40
16762.816082919016
1844
opper_lang_sv_sv_047
80
46279.98358407058
3038
opper_lang_sv_sv_048
100
19330.085624940693
2117
opper_lang_sv_sv_049
100
20445.201041991822
2203
opper_lang_sv_sv_050
100
38996.69887498021
3543
opper_lang_sv_sv_051
80
28492.807374917902
3148
opper_lang_sv_sv_052