Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

70
anthropic/claude-3.5-haiku
Average duration
8s
Average tokens
1598
Average cost
$0.00
80
5s
765
opper_lang_sv_sv_001
100
6s
740
opper_lang_sv_sv_002
100
6s
766
opper_lang_sv_sv_003
80
7s
707
opper_lang_sv_sv_004
80
5s
837
opper_lang_sv_sv_005
100
5s
802
opper_lang_sv_sv_006
80
8s
1696
opper_lang_sv_sv_007
80
5s
1663
opper_lang_sv_sv_008
80
9s
1559
opper_lang_sv_sv_009
80
10s
1822
opper_lang_sv_sv_010
80
5s
1403
opper_lang_sv_sv_011
80
7s
1446
opper_lang_sv_sv_012
80
4s
1393
opper_lang_sv_sv_013
80
9s
1693
opper_lang_sv_sv_014
80
7s
1638
opper_lang_sv_sv_015
80
9s
1636
opper_lang_sv_sv_016
80
8s
1514
opper_lang_sv_sv_017
60
5s
1450
opper_lang_sv_sv_018
40
9s
1549
opper_lang_sv_sv_019
20
4s
1446
opper_lang_sv_sv_020
80
7s
1686
opper_lang_sv_sv_021
80
9s
1735
opper_lang_sv_sv_022
80
7s
1782
opper_lang_sv_sv_023
40
7s
1720
opper_lang_sv_sv_024
50
9s
1715
opper_lang_sv_sv_025
50
12s
1915
opper_lang_sv_sv_026
80
5s
1553
opper_lang_sv_sv_027
80
8s
1627
opper_lang_sv_sv_028
80
7s
1740
opper_lang_sv_sv_029
60
7s
1571
opper_lang_sv_sv_030
80
9s
1680
opper_lang_sv_sv_031
20
5s
1581
opper_lang_sv_sv_032
80
7s
1655
opper_lang_sv_sv_033
60
9s
1687
opper_lang_sv_sv_034
80
7s
1682
opper_lang_sv_sv_035
40
9s
1745
opper_lang_sv_sv_036
50
8s
1673
opper_lang_sv_sv_037
40
8s
1678
opper_lang_sv_sv_038
20
7s
1675
opper_lang_sv_sv_039
80
12s
1716
opper_lang_sv_sv_040
80
5s
1639
opper_lang_sv_sv_041
20
9s
1655
opper_lang_sv_sv_042
80
8s
1662
opper_lang_sv_sv_043
80
8s
1645
opper_lang_sv_sv_044
80
22s
2583
opper_lang_sv_sv_045
80
7s
1706
opper_lang_sv_sv_046
80
8s
1625
opper_lang_sv_sv_047
80
8s
1585
opper_lang_sv_sv_048
60
7s
1823
opper_lang_sv_sv_049
80
9s
1832
opper_lang_sv_sv_050
80
11s
2519
opper_lang_sv_sv_051
60
8s
2473
opper_lang_sv_sv_052