Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

74
gcp/gemini-2.5-flash-lite
Average duration
14s
Average tokens
1611
Average cost
$0.00
100
15s
842
opper_lang_sv_sv_001
80
15s
701
opper_lang_sv_sv_002
100
12s
689
opper_lang_sv_sv_003
100
15s
653
opper_lang_sv_sv_004
80
14s
802
opper_lang_sv_sv_005
100
14s
730
opper_lang_sv_sv_006
40
12s
1666
opper_lang_sv_sv_007
80
15s
1622
opper_lang_sv_sv_008
80
14s
1558
opper_lang_sv_sv_009
100
12s
1857
opper_lang_sv_sv_010
80
14s
1342
opper_lang_sv_sv_011
80
14s
1375
opper_lang_sv_sv_012
80
12s
1328
opper_lang_sv_sv_013
80
12s
1660
opper_lang_sv_sv_014
100
15s
1677
opper_lang_sv_sv_015
80
11s
1690
opper_lang_sv_sv_016
80
11s
1464
opper_lang_sv_sv_017
40
11s
1379
opper_lang_sv_sv_018
60
22s
1667
opper_lang_sv_sv_019
100
18s
1601
opper_lang_sv_sv_020
80
14s
1840
opper_lang_sv_sv_021
80
14s
1724
opper_lang_sv_sv_022
0
14s
1755
opper_lang_sv_sv_023
80
14s
1715
opper_lang_sv_sv_024
80
14s
1773
opper_lang_sv_sv_025
80
15s
1720
opper_lang_sv_sv_026
100
15s
1645
opper_lang_sv_sv_027
50
15s
1567
opper_lang_sv_sv_028
80
13s
1681
opper_lang_sv_sv_029
80
15s
1558
opper_lang_sv_sv_030
80
12s
1703
opper_lang_sv_sv_031
80
12s
1955
opper_lang_sv_sv_032
80
12s
1681
opper_lang_sv_sv_033
80
14s
1765
opper_lang_sv_sv_034
80
14s
1937
opper_lang_sv_sv_035
80
14s
1929
opper_lang_sv_sv_036
0
14s
1563
opper_lang_sv_sv_037
40
14s
1709
opper_lang_sv_sv_038
50
14s
1811
opper_lang_sv_sv_039
60
10s
1731
opper_lang_sv_sv_040
50
9s
1706
opper_lang_sv_sv_041
40
9s
1584
opper_lang_sv_sv_042
80
9s
1837
opper_lang_sv_sv_043
80
29s
1510
opper_lang_sv_sv_044
80
11s
1789
opper_lang_sv_sv_045
80
11s
1687
opper_lang_sv_sv_046
40
11s
1675
opper_lang_sv_sv_047
80
11s
1791
opper_lang_sv_sv_048
80
20s
1911
opper_lang_sv_sv_049
80
20s
1823
opper_lang_sv_sv_050
80
20s
2717
opper_lang_sv_sv_051
80
20s
2667
opper_lang_sv_sv_052