Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

60
openai/gpt-4o-mini
Average duration
16s
Average tokens
1308
Average cost
$0.00
80
1m 58s
673
opper_lang_sv_sv_001
80
5s
632
opper_lang_sv_sv_002
100
9s
628
opper_lang_sv_sv_003
100
6s
592
opper_lang_sv_sv_004
50
8s
676
opper_lang_sv_sv_005
100
6s
657
opper_lang_sv_sv_006
60
9s
1431
opper_lang_sv_sv_007
60
9s
1337
opper_lang_sv_sv_008
60
31s
1337
opper_lang_sv_sv_009
80
9s
1426
opper_lang_sv_sv_010
60
9s
1173
opper_lang_sv_sv_011
80
9s
1270
opper_lang_sv_sv_012
40
9s
1149
opper_lang_sv_sv_013
80
7s
1375
opper_lang_sv_sv_014
40
9s
1291
opper_lang_sv_sv_015
60
9s
1305
opper_lang_sv_sv_016
80
9s
1255
opper_lang_sv_sv_017
80
9s
1206
opper_lang_sv_sv_018
40
9s
1289
opper_lang_sv_sv_019
80
9s
1290
opper_lang_sv_sv_020
60
8s
1431
opper_lang_sv_sv_021
50
9s
1360
opper_lang_sv_sv_022
40
1m 24s
1479
opper_lang_sv_sv_023
40
6s
1452
opper_lang_sv_sv_024
50
7s
1448
opper_lang_sv_sv_025
80
9s
1429
opper_lang_sv_sv_026
80
1m 21s
1347
opper_lang_sv_sv_027
80
8s
1406
opper_lang_sv_sv_028
80
9s
1362
opper_lang_sv_sv_029
80
9s
1349
opper_lang_sv_sv_030
80
6s
1414
opper_lang_sv_sv_031
60
7s
1385
opper_lang_sv_sv_032
60
57s
1368
opper_lang_sv_sv_033
60
7s
1431
opper_lang_sv_sv_034
50
9s
1419
opper_lang_sv_sv_035
40
7s
1497
opper_lang_sv_sv_036
60
5s
1340
opper_lang_sv_sv_037
40
6s
1388
opper_lang_sv_sv_038
40
5s
1372
opper_lang_sv_sv_039
40
8s
1345
opper_lang_sv_sv_040
50
8s
1386
opper_lang_sv_sv_041
20
8s
1366
opper_lang_sv_sv_042
80
8s
1285
opper_lang_sv_sv_043
80
8s
1300
opper_lang_sv_sv_044
0
8s
1492
opper_lang_sv_sv_045
60
6s
1392
opper_lang_sv_sv_046
40
37s
1415
opper_lang_sv_sv_047
40
8s
1328
opper_lang_sv_sv_048
20
1m 22s
1475
opper_lang_sv_sv_049
40
7s
1515
opper_lang_sv_sv_050
60
6s
2000
opper_lang_sv_sv_051
60
7s
2067
opper_lang_sv_sv_052