Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

69
mistral/magistral-medium-2506-eu
Average duration
9s
Average tokens
1562
Average cost
$0.00
60
5s
796
opper_lang_sv_sv_001
100
3s
722
opper_lang_sv_sv_002
80
3s
668
opper_lang_sv_sv_003
100
2s
656
opper_lang_sv_sv_004
80
3s
744
opper_lang_sv_sv_005
100
2s
712
opper_lang_sv_sv_006
60
4s
1554
opper_lang_sv_sv_007
60
5s
1566
opper_lang_sv_sv_008
80
4s
1582
opper_lang_sv_sv_009
60
4s
1535
opper_lang_sv_sv_010
80
4s
1303
opper_lang_sv_sv_011
80
7s
1418
opper_lang_sv_sv_012
60
3s
1340
opper_lang_sv_sv_013
80
7s
1614
opper_lang_sv_sv_014
60
9s
1950
opper_lang_sv_sv_015
80
6s
1570
opper_lang_sv_sv_016
80
10s
1680
opper_lang_sv_sv_017
80
7s
1392
opper_lang_sv_sv_018
60
35s
1396
opper_lang_sv_sv_019
80
6s
1617
opper_lang_sv_sv_020
80
7s
1707
opper_lang_sv_sv_021
40
4s
1478
opper_lang_sv_sv_022
60
6s
1733
opper_lang_sv_sv_023
40
3s
1659
opper_lang_sv_sv_024
50
1m 5s
1626
opper_lang_sv_sv_025
80
4s
1616
opper_lang_sv_sv_026
80
6s
1547
opper_lang_sv_sv_027
80
4s
1530
opper_lang_sv_sv_028
80
5s
1723
opper_lang_sv_sv_029
80
4s
1540
opper_lang_sv_sv_030
80
5s
1654
opper_lang_sv_sv_031
60
4s
1543
opper_lang_sv_sv_032
50
4s
1633
opper_lang_sv_sv_033
80
6s
1778
opper_lang_sv_sv_034
50
8s
1930
opper_lang_sv_sv_035
40
4s
1630
opper_lang_sv_sv_036
80
4s
1577
opper_lang_sv_sv_037
40
11s
2038
opper_lang_sv_sv_038
80
6s
1708
opper_lang_sv_sv_039
50
6s
1671
opper_lang_sv_sv_040
80
4s
1585
opper_lang_sv_sv_041
20
35s
1658
opper_lang_sv_sv_042
60
37s
1495
opper_lang_sv_sv_043
60
5s
1542
opper_lang_sv_sv_044
80
42s
1884
opper_lang_sv_sv_045
50
5s
1660
opper_lang_sv_sv_046
60
8s
1939
opper_lang_sv_sv_047
80
6s
1639
opper_lang_sv_sv_048
80
35s
1849
opper_lang_sv_sv_049
80
4s
1757
opper_lang_sv_sv_050
80
9s
2656
opper_lang_sv_sv_051
60
5s
2425
opper_lang_sv_sv_052