Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

67
gcp/gemini-2.0-flash
Average duration
5s
Average tokens
1509
Average cost
$0.00
80
6s
749
opper_lang_sv_sv_001
100
5s
696
opper_lang_sv_sv_002
100
5s
667
opper_lang_sv_sv_003
80
5s
641
opper_lang_sv_sv_004
50
6s
754
opper_lang_sv_sv_005
100
5s
720
opper_lang_sv_sv_006
60
6s
1565
opper_lang_sv_sv_007
100
5s
1613
opper_lang_sv_sv_008
60
5s
1465
opper_lang_sv_sv_009
80
6s
1591
opper_lang_sv_sv_010
80
5s
1323
opper_lang_sv_sv_011
60
5s
1294
opper_lang_sv_sv_012
40
5s
1290
opper_lang_sv_sv_013
80
5s
1610
opper_lang_sv_sv_014
80
5s
1475
opper_lang_sv_sv_015
60
5s
1532
opper_lang_sv_sv_016
60
7s
1408
opper_lang_sv_sv_017
40
5s
1311
opper_lang_sv_sv_018
40
5s
1487
opper_lang_sv_sv_019
80
5s
1501
opper_lang_sv_sv_020
80
6s
1601
opper_lang_sv_sv_021
60
5s
1539
opper_lang_sv_sv_022
80
6s
1746
opper_lang_sv_sv_023
80
5s
1712
opper_lang_sv_sv_024
50
6s
1648
opper_lang_sv_sv_025
50
5s
1608
opper_lang_sv_sv_026
100
5s
1517
opper_lang_sv_sv_027
60
6s
1477
opper_lang_sv_sv_028
80
5s
1508
opper_lang_sv_sv_029
60
5s
1444
opper_lang_sv_sv_030
80
6s
1655
opper_lang_sv_sv_031
40
5s
1511
opper_lang_sv_sv_032
60
3s
1606
opper_lang_sv_sv_033
80
5s
1655
opper_lang_sv_sv_034
80
6s
1582
opper_lang_sv_sv_035
40
5s
1780
opper_lang_sv_sv_036
60
6s
1752
opper_lang_sv_sv_037
40
6s
1660
opper_lang_sv_sv_038
60
5s
1676
opper_lang_sv_sv_039
20
6s
1605
opper_lang_sv_sv_040
50
5s
1549
opper_lang_sv_sv_041
40
5s
1564
opper_lang_sv_sv_042
80
5s
1478
opper_lang_sv_sv_043
50
5s
1548
opper_lang_sv_sv_044
80
7s
1935
opper_lang_sv_sv_045
60
7s
1671
opper_lang_sv_sv_046
80
5s
1610
opper_lang_sv_sv_047
60
5s
1525
opper_lang_sv_sv_048
80
5s
1863
opper_lang_sv_sv_049
80
5s
1744
opper_lang_sv_sv_050
80
5s
2601
opper_lang_sv_sv_051
60
4s
2427
opper_lang_sv_sv_052