Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

80
anthropic/claude-3.7-sonnet
Average duration
11s
Average tokens
1641
Average cost
$0.00
80
11s
814
opper_lang_sv_sv_001
100
8s
786
opper_lang_sv_sv_002
100
10s
762
opper_lang_sv_sv_003
100
8s
737
opper_lang_sv_sv_004
100
9s
854
opper_lang_sv_sv_005
100
9s
819
opper_lang_sv_sv_006
80
11s
1773
opper_lang_sv_sv_007
80
11s
1717
opper_lang_sv_sv_008
60
11s
1620
opper_lang_sv_sv_009
100
11s
1791
opper_lang_sv_sv_010
80
10s
1433
opper_lang_sv_sv_011
80
10s
1484
opper_lang_sv_sv_012
80
8s
1433
opper_lang_sv_sv_013
100
11s
1765
opper_lang_sv_sv_014
80
12s
1733
opper_lang_sv_sv_015
80
12s
1766
opper_lang_sv_sv_016
80
12s
1591
opper_lang_sv_sv_017
80
9s
1478
opper_lang_sv_sv_018
20
9s
1476
opper_lang_sv_sv_019
80
9s
1578
opper_lang_sv_sv_020
80
8s
1702
opper_lang_sv_sv_021
80
12s
1853
opper_lang_sv_sv_022
80
12s
1800
opper_lang_sv_sv_023
100
12s
1778
opper_lang_sv_sv_024
50
8s
1736
opper_lang_sv_sv_025
100
11s
1798
opper_lang_sv_sv_026
100
11s
1693
opper_lang_sv_sv_027
80
12s
1691
opper_lang_sv_sv_028
80
12s
1681
opper_lang_sv_sv_029
80
9s
1612
opper_lang_sv_sv_030
80
9s
1769
opper_lang_sv_sv_031
80
12s
1670
opper_lang_sv_sv_032
80
11s
1718
opper_lang_sv_sv_033
100
10s
1792
opper_lang_sv_sv_034
80
14s
1878
opper_lang_sv_sv_035
40
13s
1790
opper_lang_sv_sv_036
80
9s
1741
opper_lang_sv_sv_037
60
13s
1794
opper_lang_sv_sv_038
50
13s
1695
opper_lang_sv_sv_039
50
13s
1726
opper_lang_sv_sv_040
100
11s
1745
opper_lang_sv_sv_041
60
11s
1800
opper_lang_sv_sv_042
80
10s
1687
opper_lang_sv_sv_043
80
8s
1624
opper_lang_sv_sv_044
80
14s
1908
opper_lang_sv_sv_045
80
14s
1700
opper_lang_sv_sv_046
80
12s
1695
opper_lang_sv_sv_047
80
10s
1768
opper_lang_sv_sv_048
80
13s
1957
opper_lang_sv_sv_049
100
17s
1924
opper_lang_sv_sv_050
80
13s
2636
opper_lang_sv_sv_051
80
14s
2575
opper_lang_sv_sv_052