Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

80
groq/moonshotai/kimi-k2-instruct
Average duration
6s
Average tokens
1508
Average cost
$0.00
80
6s
757
opper_lang_sv_sv_001
100
3s
667
opper_lang_sv_sv_002
100
5s
660
opper_lang_sv_sv_003
100
4s
641
opper_lang_sv_sv_004
80
5s
728
opper_lang_sv_sv_005
100
5s
676
opper_lang_sv_sv_006
80
4s
1590
opper_lang_sv_sv_007
100
4s
1582
opper_lang_sv_sv_008
100
7s
1451
opper_lang_sv_sv_009
80
4s
1544
opper_lang_sv_sv_010
80
4s
1364
opper_lang_sv_sv_011
80
4s
1441
opper_lang_sv_sv_012
20
4s
1260
opper_lang_sv_sv_013
100
4s
1565
opper_lang_sv_sv_014
80
5s
1606
opper_lang_sv_sv_015
80
4s
1560
opper_lang_sv_sv_016
80
9s
1496
opper_lang_sv_sv_017
40
4s
1349
opper_lang_sv_sv_018
40
12s
1445
opper_lang_sv_sv_019
80
8s
1389
opper_lang_sv_sv_020
80
4s
1649
opper_lang_sv_sv_021
100
18s
1648
opper_lang_sv_sv_022
80
5s
1683
opper_lang_sv_sv_023
80
14s
1676
opper_lang_sv_sv_024
80
12s
1654
opper_lang_sv_sv_025
80
4s
1667
opper_lang_sv_sv_026
100
4s
1500
opper_lang_sv_sv_027
80
4s
1590
opper_lang_sv_sv_028
80
5s
1709
opper_lang_sv_sv_029
80
4s
1513
opper_lang_sv_sv_030
80
5s
1620
opper_lang_sv_sv_031
80
5s
1781
opper_lang_sv_sv_032
80
9s
1587
opper_lang_sv_sv_033
100
4s
1694
opper_lang_sv_sv_034
80
5s
1666
opper_lang_sv_sv_035
80
4s
1830
opper_lang_sv_sv_036
80
4s
1569
opper_lang_sv_sv_037
60
31s
1699
opper_lang_sv_sv_038
50
10s
1624
opper_lang_sv_sv_039
80
5s
1520
opper_lang_sv_sv_040
80
4s
1561
opper_lang_sv_sv_041
80
4s
1579
opper_lang_sv_sv_042
80
5s
1583
opper_lang_sv_sv_043
80
5s
1442
opper_lang_sv_sv_044
100
5s
1813
opper_lang_sv_sv_045
100
5s
1594
opper_lang_sv_sv_046
40
4s
1515
opper_lang_sv_sv_047
60
4s
1501
opper_lang_sv_sv_048
80
4s
1757
opper_lang_sv_sv_049
80
4s
1787
opper_lang_sv_sv_050
80
5s
2347
opper_lang_sv_sv_051
80
4s
2277
opper_lang_sv_sv_052