Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

68
fireworks/deepseek-v3
Average duration
0
Average tokens
0
Average cost
$0
80
null
0
opper_lang_sv_sv_001
100
null
0
opper_lang_sv_sv_002
100
null
0
opper_lang_sv_sv_003
100
null
0
opper_lang_sv_sv_004
80
null
0
opper_lang_sv_sv_005
80
null
0
opper_lang_sv_sv_006
60
null
0
opper_lang_sv_sv_007
50
null
0
opper_lang_sv_sv_008
80
null
0
opper_lang_sv_sv_009
40
null
0
opper_lang_sv_sv_010
80
null
0
opper_lang_sv_sv_011
80
null
0
opper_lang_sv_sv_012
40
null
0
opper_lang_sv_sv_013
80
null
0
opper_lang_sv_sv_014
80
null
0
opper_lang_sv_sv_015
60
null
0
opper_lang_sv_sv_016
80
null
0
opper_lang_sv_sv_017
80
null
0
opper_lang_sv_sv_018
40
null
0
opper_lang_sv_sv_019
60
null
0
opper_lang_sv_sv_020
80
null
0
opper_lang_sv_sv_021
80
null
0
opper_lang_sv_sv_022
50
null
0
opper_lang_sv_sv_023
40
null
0
opper_lang_sv_sv_024
80
null
0
opper_lang_sv_sv_025
60
null
0
opper_lang_sv_sv_026
80
null
0
opper_lang_sv_sv_027
80
null
0
opper_lang_sv_sv_028
80
null
0
opper_lang_sv_sv_029
80
null
0
opper_lang_sv_sv_030
80
null
0
opper_lang_sv_sv_031
60
null
0
opper_lang_sv_sv_032
40
null
0
opper_lang_sv_sv_033
80
null
0
opper_lang_sv_sv_034
80
null
0
opper_lang_sv_sv_035
60
null
0
opper_lang_sv_sv_036
60
null
0
opper_lang_sv_sv_037
60
null
0
opper_lang_sv_sv_038
40
null
0
opper_lang_sv_sv_039
50
null
0
opper_lang_sv_sv_040
50
null
0
opper_lang_sv_sv_041
40
null
0
opper_lang_sv_sv_042
60
null
0
opper_lang_sv_sv_043
80
null
0
opper_lang_sv_sv_044
80
null
0
opper_lang_sv_sv_045
50
null
0
opper_lang_sv_sv_046
60
null
0
opper_lang_sv_sv_047
60
null
0
opper_lang_sv_sv_048
80
null
0
opper_lang_sv_sv_049
80
null
0
opper_lang_sv_sv_050
80
null
0
opper_lang_sv_sv_051
60
null
0
opper_lang_sv_sv_052