Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

78
anthropic/claude-3.5-sonnet
Average duration
7s
Average tokens
1593
Average cost
$0.00
80
6s
821
opper_lang_sv_sv_001
100
4s
749
opper_lang_sv_sv_002
100
4s
743
opper_lang_sv_sv_003
100
4s
715
opper_lang_sv_sv_004
80
5s
840
opper_lang_sv_sv_005
80
4s
820
opper_lang_sv_sv_006
60
6s
1695
opper_lang_sv_sv_007
80
6s
1683
opper_lang_sv_sv_008
80
4s
1556
opper_lang_sv_sv_009
80
7s
1713
opper_lang_sv_sv_010
100
5s
1395
opper_lang_sv_sv_011
100
6s
1460
opper_lang_sv_sv_012
80
5s
1398
opper_lang_sv_sv_013
80
8s
1690
opper_lang_sv_sv_014
80
7s
1616
opper_lang_sv_sv_015
80
7s
1662
opper_lang_sv_sv_016
80
8s
1601
opper_lang_sv_sv_017
80
5s
1445
opper_lang_sv_sv_018
60
6s
1546
opper_lang_sv_sv_019
80
5s
1536
opper_lang_sv_sv_020
80
8s
1765
opper_lang_sv_sv_021
80
7s
1715
opper_lang_sv_sv_022
80
7s
1766
opper_lang_sv_sv_023
60
5s
1719
opper_lang_sv_sv_024
60
7s
1693
opper_lang_sv_sv_025
100
9s
1784
opper_lang_sv_sv_026
80
8s
1630
opper_lang_sv_sv_027
50
7s
1625
opper_lang_sv_sv_028
80
8s
1682
opper_lang_sv_sv_029
80
7s
1554
opper_lang_sv_sv_030
60
8s
1700
opper_lang_sv_sv_031
80
8s
1703
opper_lang_sv_sv_032
80
7s
1691
opper_lang_sv_sv_033
100
8s
1767
opper_lang_sv_sv_034
80
9s
1764
opper_lang_sv_sv_035
80
9s
1802
opper_lang_sv_sv_036
80
9s
1753
opper_lang_sv_sv_037
80
6s
1650
opper_lang_sv_sv_038
40
6s
1670
opper_lang_sv_sv_039
80
8s
1737
opper_lang_sv_sv_040
80
6s
1698
opper_lang_sv_sv_041
20
5s
1592
opper_lang_sv_sv_042
80
8s
1660
opper_lang_sv_sv_043
80
6s
1581
opper_lang_sv_sv_044
100
8s
1826
opper_lang_sv_sv_045
80
8s
1749
opper_lang_sv_sv_046
80
5s
1588
opper_lang_sv_sv_047
60
6s
1612
opper_lang_sv_sv_048
80
6s
1812
opper_lang_sv_sv_049
100
7s
1865
opper_lang_sv_sv_050
80
9s
2563
opper_lang_sv_sv_051
60
8s
2452
opper_lang_sv_sv_052