Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

73
groq/gpt-oss-20b
Average duration
3s
Average tokens
1814
Average cost
$0.00
80
4s
1204
opper_lang_sv_sv_001
80
4s
996
opper_lang_sv_sv_002
100
2s
962
opper_lang_sv_sv_003
100
2s
927
opper_lang_sv_sv_004
80
2s
915
opper_lang_sv_sv_005
80
3s
935
opper_lang_sv_sv_006
80
2s
1840
opper_lang_sv_sv_007
80
9s
1882
opper_lang_sv_sv_008
80
7s
1516
opper_lang_sv_sv_009
80
3s
1820
opper_lang_sv_sv_010
100
4s
1749
opper_lang_sv_sv_011
80
3s
1488
opper_lang_sv_sv_012
20
4s
1538
opper_lang_sv_sv_013
80
3s
1660
opper_lang_sv_sv_014
60
3s
1576
opper_lang_sv_sv_015
80
2s
1815
opper_lang_sv_sv_016
80
4s
1656
opper_lang_sv_sv_017
80
4s
1835
opper_lang_sv_sv_018
40
4s
1781
opper_lang_sv_sv_019
60
2s
1767
opper_lang_sv_sv_020
40
4s
1856
opper_lang_sv_sv_021
80
2s
1812
opper_lang_sv_sv_022
60
4s
2048
opper_lang_sv_sv_023
80
4s
2373
opper_lang_sv_sv_024
80
2s
1905
opper_lang_sv_sv_025
80
3s
1748
opper_lang_sv_sv_026
50
6s
2278
opper_lang_sv_sv_027
80
2s
2002
opper_lang_sv_sv_028
80
3s
1624
opper_lang_sv_sv_029
80
4s
1932
opper_lang_sv_sv_030
50
2s
2085
opper_lang_sv_sv_031
80
4s
2016
opper_lang_sv_sv_032
80
3s
1756
opper_lang_sv_sv_033
80
2s
1920
opper_lang_sv_sv_034
80
3s
1767
opper_lang_sv_sv_035
40
4s
2293
opper_lang_sv_sv_036
80
2s
1861
opper_lang_sv_sv_037
40
2s
2494
opper_lang_sv_sv_038
50
2s
1804
opper_lang_sv_sv_039
80
2s
1781
opper_lang_sv_sv_040
80
2s
1651
opper_lang_sv_sv_041
80
2s
2018
opper_lang_sv_sv_042
80
4s
2258
opper_lang_sv_sv_043
80
2s
2030
opper_lang_sv_sv_044
80
4s
1868
opper_lang_sv_sv_045
80
4s
2277
opper_lang_sv_sv_046
100
2s
1672
opper_lang_sv_sv_047
80
4s
1955
opper_lang_sv_sv_048
80
2s
1984
opper_lang_sv_sv_049
20
4s
2498
opper_lang_sv_sv_050
80
2s
2263
opper_lang_sv_sv_051
80
4s
2622
opper_lang_sv_sv_052