Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

70
fireworks/deepseek-v3
Average duration
9s
Average tokens
1413
Average cost
$0.00
80
5s
729
opper_lang_sv_sv_001
100
6s
699
opper_lang_sv_sv_002
100
5s
638
opper_lang_sv_sv_003
80
3s
619
opper_lang_sv_sv_004
80
4s
717
opper_lang_sv_sv_005
100
4s
676
opper_lang_sv_sv_006
60
7s
1526
opper_lang_sv_sv_007
80
13s
1507
opper_lang_sv_sv_008
80
7s
1460
opper_lang_sv_sv_009
80
6s
1457
opper_lang_sv_sv_010
100
17s
1301
opper_lang_sv_sv_011
100
7s
1400
opper_lang_sv_sv_012
40
4s
1267
opper_lang_sv_sv_013
80
7s
1455
opper_lang_sv_sv_014
80
5s
1445
opper_lang_sv_sv_015
40
10s
1380
opper_lang_sv_sv_016
80
10s
1439
opper_lang_sv_sv_017
40
7s
1281
opper_lang_sv_sv_018
40
11s
1354
opper_lang_sv_sv_019
80
9s
1367
opper_lang_sv_sv_020
80
11s
1630
opper_lang_sv_sv_021
80
11s
1535
opper_lang_sv_sv_022
60
10s
1560
opper_lang_sv_sv_023
50
9s
1582
opper_lang_sv_sv_024
50
9s
1535
opper_lang_sv_sv_025
80
8s
1570
opper_lang_sv_sv_026
80
10s
1516
opper_lang_sv_sv_027
80
8s
1446
opper_lang_sv_sv_028
80
9s
1450
opper_lang_sv_sv_029
80
11s
1477
opper_lang_sv_sv_030
60
10s
1437
opper_lang_sv_sv_031
60
9s
1468
opper_lang_sv_sv_032
40
6s
1484
opper_lang_sv_sv_033
80
8s
1547
opper_lang_sv_sv_034
80
12s
1530
opper_lang_sv_sv_035
40
10s
1604
opper_lang_sv_sv_036
60
11s
1464
opper_lang_sv_sv_037
60
8s
1480
opper_lang_sv_sv_038
80
8s
1483
opper_lang_sv_sv_039
50
8s
1461
opper_lang_sv_sv_040
80
10s
1525
opper_lang_sv_sv_041
20
8s
1437
opper_lang_sv_sv_042
80
11s
1481
opper_lang_sv_sv_043
80
11s
1473
opper_lang_sv_sv_044
80
12s
1607
opper_lang_sv_sv_045
80
9s
1575
opper_lang_sv_sv_046
40
14s
1438
opper_lang_sv_sv_047
60
15s
1379
opper_lang_sv_sv_048
50
8s
1640
opper_lang_sv_sv_049
80
15s
1583
opper_lang_sv_sv_050
80
10s
2148
opper_lang_sv_sv_051
60
9s
2238
opper_lang_sv_sv_052