Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

76
fireworks/qwen3-coder-480b-a35b-instruct
Average duration
8s
Average tokens
1634
Average cost
$0.00
100
9s
829
opper_lang_sv_sv_001
100
6s
727
opper_lang_sv_sv_002
100
3s
696
opper_lang_sv_sv_003
100
5s
652
opper_lang_sv_sv_004
80
5s
750
opper_lang_sv_sv_005
100
5s
695
opper_lang_sv_sv_006
80
10s
1786
opper_lang_sv_sv_007
80
7s
1764
opper_lang_sv_sv_008
100
9s
1623
opper_lang_sv_sv_009
80
9s
1654
opper_lang_sv_sv_010
80
5s
1417
opper_lang_sv_sv_011
80
7s
1482
opper_lang_sv_sv_012
60
5s
1393
opper_lang_sv_sv_013
100
8s
1648
opper_lang_sv_sv_014
80
10s
1617
opper_lang_sv_sv_015
50
24s
1614
opper_lang_sv_sv_016
80
9s
1606
opper_lang_sv_sv_017
80
5s
1465
opper_lang_sv_sv_018
60
10s
1605
opper_lang_sv_sv_019
80
4s
1472
opper_lang_sv_sv_020
80
7s
1816
opper_lang_sv_sv_021
100
6s
1737
opper_lang_sv_sv_022
80
11s
1828
opper_lang_sv_sv_023
50
7s
1755
opper_lang_sv_sv_024
80
7s
1777
opper_lang_sv_sv_025
80
11s
1824
opper_lang_sv_sv_026
80
7s
1725
opper_lang_sv_sv_027
80
14s
1714
opper_lang_sv_sv_028
80
10s
1771
opper_lang_sv_sv_029
80
5s
1688
opper_lang_sv_sv_030
60
6s
1780
opper_lang_sv_sv_031
80
10s
1704
opper_lang_sv_sv_032
80
8s
1699
opper_lang_sv_sv_033
100
12s
1766
opper_lang_sv_sv_034
80
8s
1787
opper_lang_sv_sv_035
60
18s
1962
opper_lang_sv_sv_036
50
4s
1665
opper_lang_sv_sv_037
60
8s
2110
opper_lang_sv_sv_038
50
5s
1662
opper_lang_sv_sv_039
50
7s
1798
opper_lang_sv_sv_040
50
5s
1793
opper_lang_sv_sv_041
40
7s
1738
opper_lang_sv_sv_042
50
9s
1678
opper_lang_sv_sv_043
80
7s
1701
opper_lang_sv_sv_044
80
7s
1958
opper_lang_sv_sv_045
80
5s
1735
opper_lang_sv_sv_046
60
4s
1599
opper_lang_sv_sv_047
60
7s
1590
opper_lang_sv_sv_048
100
9s
2126
opper_lang_sv_sv_049
80
7s
1890
opper_lang_sv_sv_050
80
7s
2571
opper_lang_sv_sv_051
60
5s
2509
opper_lang_sv_sv_052