Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

79
gcp/gemini-flash-lite-latest
Average duration
3s
Average tokens
1838
Average cost
$0.00
80
3s
933
opper_lang_sv_sv_001
80
2s
872
opper_lang_sv_sv_002
100
3s
845
opper_lang_sv_sv_003
100
2s
813
opper_lang_sv_sv_004
100
2s
959
opper_lang_sv_sv_005
80
2s
871
opper_lang_sv_sv_006
80
3s
1927
opper_lang_sv_sv_007
80
3s
1831
opper_lang_sv_sv_008
80
2s
1726
opper_lang_sv_sv_009
80
3s
1942
opper_lang_sv_sv_010
80
2s
1516
opper_lang_sv_sv_011
80
2s
1536
opper_lang_sv_sv_012
80
2s
1552
opper_lang_sv_sv_013
80
3s
1924
opper_lang_sv_sv_014
80
3s
1810
opper_lang_sv_sv_015
80
3s
2194
opper_lang_sv_sv_016
80
3s
1823
opper_lang_sv_sv_017
40
2s
1586
opper_lang_sv_sv_018
60
3s
1805
opper_lang_sv_sv_019
80
2s
1722
opper_lang_sv_sv_020
80
4s
2389
opper_lang_sv_sv_021
80
3s
1987
opper_lang_sv_sv_022
80
3s
2083
opper_lang_sv_sv_023
60
3s
2029
opper_lang_sv_sv_024
80
3s
1885
opper_lang_sv_sv_025
80
2s
1955
opper_lang_sv_sv_026
100
2s
1804
opper_lang_sv_sv_027
60
2s
1767
opper_lang_sv_sv_028
100
2s
1763
opper_lang_sv_sv_029
60
2s
1696
opper_lang_sv_sv_030
80
3s
1911
opper_lang_sv_sv_031
80
2s
1854
opper_lang_sv_sv_032
80
2s
1894
opper_lang_sv_sv_033
90
3s
1949
opper_lang_sv_sv_034
80
3s
1983
opper_lang_sv_sv_035
80
3s
2080
opper_lang_sv_sv_036
80
2s
1861
opper_lang_sv_sv_037
40
3s
2035
opper_lang_sv_sv_038
100
2s
1867
opper_lang_sv_sv_039
80
3s
2137
opper_lang_sv_sv_040
80
2s
1867
opper_lang_sv_sv_041
60
3s
1925
opper_lang_sv_sv_042
80
3s
1796
opper_lang_sv_sv_043
90
2s
1688
opper_lang_sv_sv_044
80
4s
2541
opper_lang_sv_sv_045
80
3s
2117
opper_lang_sv_sv_046
40
2s
1948
opper_lang_sv_sv_047
80
3s
2283
opper_lang_sv_sv_048
100
3s
2134
opper_lang_sv_sv_049
100
2s
2113
opper_lang_sv_sv_050
80
4s
3210
opper_lang_sv_sv_051
80
3s
2813
opper_lang_sv_sv_052