Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

84
anthropic/claude-opus-4
Average duration
33s
Average tokens
1715
Average cost
$0.00
80
19s
823
opper_lang_sv_sv_001
100
11s
752
opper_lang_sv_sv_002
100
10s
749
opper_lang_sv_sv_003
100
9s
708
opper_lang_sv_sv_004
80
17s
852
opper_lang_sv_sv_005
80
12s
811
opper_lang_sv_sv_006
80
37s
1868
opper_lang_sv_sv_007
80
29s
1757
opper_lang_sv_sv_008
100
23s
1661
opper_lang_sv_sv_009
100
33s
1814
opper_lang_sv_sv_010
100
24s
1503
opper_lang_sv_sv_011
80
23s
1492
opper_lang_sv_sv_012
100
19s
1415
opper_lang_sv_sv_013
80
31s
1707
opper_lang_sv_sv_014
80
29s
1672
opper_lang_sv_sv_015
80
33s
1716
opper_lang_sv_sv_016
80
50s
1875
opper_lang_sv_sv_017
80
22s
1534
opper_lang_sv_sv_018
80
26s
1608
opper_lang_sv_sv_019
80
33s
1662
opper_lang_sv_sv_020
80
39s
1951
opper_lang_sv_sv_021
100
42s
1888
opper_lang_sv_sv_022
80
34s
1903
opper_lang_sv_sv_023
100
43s
1991
opper_lang_sv_sv_024
80
36s
1852
opper_lang_sv_sv_025
80
32s
1844
opper_lang_sv_sv_026
100
39s
1856
opper_lang_sv_sv_027
80
28s
1712
opper_lang_sv_sv_028
100
34s
1772
opper_lang_sv_sv_029
80
23s
1620
opper_lang_sv_sv_030
80
32s
1792
opper_lang_sv_sv_031
80
43s
1850
opper_lang_sv_sv_032
80
20s
1720
opper_lang_sv_sv_033
100
33s
1858
opper_lang_sv_sv_034
80
41s
1867
opper_lang_sv_sv_035
60
34s
1858
opper_lang_sv_sv_036
80
40s
1916
opper_lang_sv_sv_037
60
35s
1819
opper_lang_sv_sv_038
100
41s
1942
opper_lang_sv_sv_039
80
1m 29s
1887
opper_lang_sv_sv_040
50
35s
1884
opper_lang_sv_sv_041
50
46s
1929
opper_lang_sv_sv_042
80
37s
1811
opper_lang_sv_sv_043
80
27s
1672
opper_lang_sv_sv_044
80
30s
1878
opper_lang_sv_sv_045
80
38s
1954
opper_lang_sv_sv_046
100
26s
1775
opper_lang_sv_sv_047
80
33s
1820
opper_lang_sv_sv_048
100
42s
2058
opper_lang_sv_sv_049
80
43s
2021
opper_lang_sv_sv_050
100
1m
2834
opper_lang_sv_sv_051
80
50s
2664
opper_lang_sv_sv_052