Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

73
cerebras/llama-4-maverick-17b-128e-instruct
Average duration
2s
Average tokens
1363
Average cost
$0.00
50
2s
663
opper_lang_sv_sv_001
80
2s
668
opper_lang_sv_sv_002
100
1s
640
opper_lang_sv_sv_003
100
2s
582
opper_lang_sv_sv_004
50
2s
701
opper_lang_sv_sv_005
100
1s
648
opper_lang_sv_sv_006
60
2s
1414
opper_lang_sv_sv_007
60
2s
1488
opper_lang_sv_sv_008
80
2s
1330
opper_lang_sv_sv_009
80
2s
1418
opper_lang_sv_sv_010
80
2s
1212
opper_lang_sv_sv_011
80
2s
1247
opper_lang_sv_sv_012
40
2s
1159
opper_lang_sv_sv_013
80
2s
1400
opper_lang_sv_sv_014
80
2s
1387
opper_lang_sv_sv_015
80
2s
1419
opper_lang_sv_sv_016
80
2s
1332
opper_lang_sv_sv_017
80
2s
1193
opper_lang_sv_sv_018
60
2s
1265
opper_lang_sv_sv_019
80
2s
1220
opper_lang_sv_sv_020
50
2s
1506
opper_lang_sv_sv_021
80
2s
1408
opper_lang_sv_sv_022
80
2s
1527
opper_lang_sv_sv_023
80
2s
1529
opper_lang_sv_sv_024
60
2s
1411
opper_lang_sv_sv_025
100
1s
1459
opper_lang_sv_sv_026
100
2s
1398
opper_lang_sv_sv_027
50
2s
1416
opper_lang_sv_sv_028
80
2s
1532
opper_lang_sv_sv_029
80
2s
1306
opper_lang_sv_sv_030
80
2s
1443
opper_lang_sv_sv_031
60
2s
1401
opper_lang_sv_sv_032
80
2s
1393
opper_lang_sv_sv_033
80
2s
1439
opper_lang_sv_sv_034
80
2s
1574
opper_lang_sv_sv_035
40
2s
1968
opper_lang_sv_sv_036
40
2s
1460
opper_lang_sv_sv_037
40
2s
1462
opper_lang_sv_sv_038
100
2s
1442
opper_lang_sv_sv_039
50
2s
1456
opper_lang_sv_sv_040
50
2s
1425
opper_lang_sv_sv_041
50
2s
1463
opper_lang_sv_sv_042
80
2s
1398
opper_lang_sv_sv_043
80
2s
1347
opper_lang_sv_sv_044
100
2s
1567
opper_lang_sv_sv_045
80
2s
1580
opper_lang_sv_sv_046
80
2s
1442
opper_lang_sv_sv_047
60
2s
1335
opper_lang_sv_sv_048
80
2s
1563
opper_lang_sv_sv_049
80
2s
1566
opper_lang_sv_sv_050
80
2s
2132
opper_lang_sv_sv_051
60
2s
2117
opper_lang_sv_sv_052