Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

86
anthropic/claude-sonnet-4
Average duration
11s
Average tokens
1732
Average cost
$0.00
80
9s
869
opper_lang_sv_sv_001
100
7s
833
opper_lang_sv_sv_002
100
6s
743
opper_lang_sv_sv_003
100
6s
716
opper_lang_sv_sv_004
100
9s
913
opper_lang_sv_sv_005
80
5s
803
opper_lang_sv_sv_006
80
12s
1860
opper_lang_sv_sv_007
100
12s
1799
opper_lang_sv_sv_008
100
8s
1661
opper_lang_sv_sv_009
100
12s
1875
opper_lang_sv_sv_010
100
10s
1504
opper_lang_sv_sv_011
80
33s
1527
opper_lang_sv_sv_012
100
9s
1459
opper_lang_sv_sv_013
80
12s
1792
opper_lang_sv_sv_014
100
13s
1740
opper_lang_sv_sv_015
100
11s
1761
opper_lang_sv_sv_016
80
15s
1834
opper_lang_sv_sv_017
40
6s
1487
opper_lang_sv_sv_018
80
10s
1687
opper_lang_sv_sv_019
100
11s
1733
opper_lang_sv_sv_020
80
12s
1982
opper_lang_sv_sv_021
80
14s
1908
opper_lang_sv_sv_022
80
12s
1998
opper_lang_sv_sv_023
80
9s
1864
opper_lang_sv_sv_024
80
11s
1882
opper_lang_sv_sv_025
80
12s
1962
opper_lang_sv_sv_026
100
9s
1767
opper_lang_sv_sv_027
50
9s
1773
opper_lang_sv_sv_028
100
11s
1817
opper_lang_sv_sv_029
80
7s
1599
opper_lang_sv_sv_030
80
11s
1846
opper_lang_sv_sv_031
80
14s
1912
opper_lang_sv_sv_032
100
6s
1738
opper_lang_sv_sv_033
80
11s
1927
opper_lang_sv_sv_034
80
12s
1926
opper_lang_sv_sv_035
80
10s
1901
opper_lang_sv_sv_036
80
12s
1899
opper_lang_sv_sv_037
60
10s
1845
opper_lang_sv_sv_038
100
11s
1850
opper_lang_sv_sv_039
80
13s
1900
opper_lang_sv_sv_040
80
9s
1802
opper_lang_sv_sv_041
100
8s
1834
opper_lang_sv_sv_042
80
14s
1844
opper_lang_sv_sv_043
100
16s
1713
opper_lang_sv_sv_044
80
12s
1902
opper_lang_sv_sv_045
100
11s
1837
opper_lang_sv_sv_046
100
8s
1740
opper_lang_sv_sv_047
80
11s
1807
opper_lang_sv_sv_048
80
13s
2053
opper_lang_sv_sv_049
80
12s
2086
opper_lang_sv_sv_050
100
17s
2857
opper_lang_sv_sv_051
80
13s
2680
opper_lang_sv_sv_052