Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

65
gcp/gemini-2.0-flash-lite
Average duration
5s
Average tokens
1530
Average cost
$0.00
80
5s
699
opper_lang_sv_sv_001
100
3s
661
opper_lang_sv_sv_002
100
5s
663
opper_lang_sv_sv_003
100
5s
641
opper_lang_sv_sv_004
80
5s
703
opper_lang_sv_sv_005
100
5s
715
opper_lang_sv_sv_006
80
9s
2336
opper_lang_sv_sv_007
60
5s
1580
opper_lang_sv_sv_008
60
4s
1478
opper_lang_sv_sv_009
60
5s
1576
opper_lang_sv_sv_010
80
5s
1320
opper_lang_sv_sv_011
60
5s
1466
opper_lang_sv_sv_012
20
4s
1300
opper_lang_sv_sv_013
80
5s
1550
opper_lang_sv_sv_014
80
5s
1509
opper_lang_sv_sv_015
60
4s
1515
opper_lang_sv_sv_016
60
4s
1378
opper_lang_sv_sv_017
60
4s
1331
opper_lang_sv_sv_018
40
5s
1466
opper_lang_sv_sv_019
80
5s
1410
opper_lang_sv_sv_020
50
5s
1596
opper_lang_sv_sv_021
50
5s
1571
opper_lang_sv_sv_022
60
5s
1708
opper_lang_sv_sv_023
60
5s
1682
opper_lang_sv_sv_024
80
5s
1707
opper_lang_sv_sv_025
60
5s
1679
opper_lang_sv_sv_026
100
5s
1485
opper_lang_sv_sv_027
60
5s
1529
opper_lang_sv_sv_028
80
5s
1538
opper_lang_sv_sv_029
40
7s
2125
opper_lang_sv_sv_030
60
5s
1848
opper_lang_sv_sv_031
80
4s
1600
opper_lang_sv_sv_032
100
3s
1603
opper_lang_sv_sv_033
80
5s
1689
opper_lang_sv_sv_034
80
5s
1557
opper_lang_sv_sv_035
60
5s
1764
opper_lang_sv_sv_036
50
5s
1600
opper_lang_sv_sv_037
60
5s
1621
opper_lang_sv_sv_038
20
3s
1524
opper_lang_sv_sv_039
50
5s
1574
opper_lang_sv_sv_040
50
5s
1613
opper_lang_sv_sv_041
40
3s
1564
opper_lang_sv_sv_042
40
5s
1622
opper_lang_sv_sv_043
50
5s
1535
opper_lang_sv_sv_044
80
4s
1721
opper_lang_sv_sv_045
50
4s
1636
opper_lang_sv_sv_046
40
4s
1548
opper_lang_sv_sv_047
40
4s
1468
opper_lang_sv_sv_048
80
4s
1814
opper_lang_sv_sv_049
60
4s
1920
opper_lang_sv_sv_050
60
4s
2440
opper_lang_sv_sv_051
60
4s
2396
opper_lang_sv_sv_052