Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

83
mistral/mistral-large-eu
Average duration
20s
Average tokens
2145
Average cost
$0.00
80
9s
929
opper_lang_sv_sv_001
80
6s
786
opper_lang_sv_sv_002
100
4s
726
opper_lang_sv_sv_003
100
4s
715
opper_lang_sv_sv_004
80
8s
869
opper_lang_sv_sv_005
100
4s
727
opper_lang_sv_sv_006
80
12s
1910
opper_lang_sv_sv_007
80
11s
1771
opper_lang_sv_sv_008
100
12s
1882
opper_lang_sv_sv_009
100
15s
1973
opper_lang_sv_sv_010
80
10s
1625
opper_lang_sv_sv_011
80
9s
1578
opper_lang_sv_sv_012
100
11s
1730
opper_lang_sv_sv_013
100
17s
2053
opper_lang_sv_sv_014
80
10s
1746
opper_lang_sv_sv_015
80
29s
2677
opper_lang_sv_sv_016
80
17s
1939
opper_lang_sv_sv_017
80
14s
1794
opper_lang_sv_sv_018
60
16s
1851
opper_lang_sv_sv_019
80
20s
2191
opper_lang_sv_sv_020
80
18s
2220
opper_lang_sv_sv_021
80
23s
2339
opper_lang_sv_sv_022
80
24s
2632
opper_lang_sv_sv_023
80
29s
2789
opper_lang_sv_sv_024
100
14s
2154
opper_lang_sv_sv_025
100
18s
2293
opper_lang_sv_sv_026
100
18s
2032
opper_lang_sv_sv_027
80
16s
1959
opper_lang_sv_sv_028
80
14s
1962
opper_lang_sv_sv_029
80
28s
2412
opper_lang_sv_sv_030
100
50s
2925
opper_lang_sv_sv_031
80
35s
2436
opper_lang_sv_sv_032
80
13s
2035
opper_lang_sv_sv_033
80
19s
2278
opper_lang_sv_sv_034
100
40s
2752
opper_lang_sv_sv_035
80
20s
2340
opper_lang_sv_sv_036
80
22s
2343
opper_lang_sv_sv_037
80
15s
2040
opper_lang_sv_sv_038
80
38s
4666
opper_lang_sv_sv_039
80
30s
2674
opper_lang_sv_sv_040
100
15s
1955
opper_lang_sv_sv_041
40
24s
1828
opper_lang_sv_sv_042
80
25s
2441
opper_lang_sv_sv_043
80
19s
2071
opper_lang_sv_sv_044
80
15s
2032
opper_lang_sv_sv_045
80
21s
2287
opper_lang_sv_sv_046
50
17s
2113
opper_lang_sv_sv_047
80
28s
2688
opper_lang_sv_sv_048
80
11s
2004
opper_lang_sv_sv_049
80
19s
2340
opper_lang_sv_sv_050
80
1m 17s
5902
opper_lang_sv_sv_051
80
55s
3102
opper_lang_sv_sv_052