Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

75
openai/gpt-4o
Average duration
13s
Average tokens
1398
Average cost
$0.00
80
9s
761
opper_lang_sv_sv_001
100
5s
647
opper_lang_sv_sv_002
100
31s
624
opper_lang_sv_sv_003
100
36s
606
opper_lang_sv_sv_004
100
6s
719
opper_lang_sv_sv_005
100
13s
683
opper_lang_sv_sv_006
80
10s
1543
opper_lang_sv_sv_007
100
9s
1463
opper_lang_sv_sv_008
80
8s
1464
opper_lang_sv_sv_009
80
9s
1502
opper_lang_sv_sv_010
80
9s
1273
opper_lang_sv_sv_011
80
9s
1299
opper_lang_sv_sv_012
40
6s
1205
opper_lang_sv_sv_013
80
8s
1423
opper_lang_sv_sv_014
80
9s
1409
opper_lang_sv_sv_015
80
10s
1472
opper_lang_sv_sv_016
80
50s
1332
opper_lang_sv_sv_017
80
9s
1281
opper_lang_sv_sv_018
40
10s
1307
opper_lang_sv_sv_019
80
9s
1317
opper_lang_sv_sv_020
80
13s
1623
opper_lang_sv_sv_021
80
9s
1471
opper_lang_sv_sv_022
80
9s
1612
opper_lang_sv_sv_023
60
9s
1611
opper_lang_sv_sv_024
80
9s
1482
opper_lang_sv_sv_025
80
9s
1567
opper_lang_sv_sv_026
80
9s
1482
opper_lang_sv_sv_027
50
9s
1449
opper_lang_sv_sv_028
80
13s
1526
opper_lang_sv_sv_029
80
13s
1431
opper_lang_sv_sv_030
80
7s
1503
opper_lang_sv_sv_031
80
12s
1524
opper_lang_sv_sv_032
80
8s
1429
opper_lang_sv_sv_033
80
9s
1519
opper_lang_sv_sv_034
80
10s
1515
opper_lang_sv_sv_035
40
12s
1699
opper_lang_sv_sv_036
60
7s
1409
opper_lang_sv_sv_037
20
8s
1457
opper_lang_sv_sv_038
40
7s
1475
opper_lang_sv_sv_039
80
14s
1629
opper_lang_sv_sv_040
80
8s
1428
opper_lang_sv_sv_041
50
1m 2s
1514
opper_lang_sv_sv_042
50
9s
1374
opper_lang_sv_sv_043
80
8s
1415
opper_lang_sv_sv_044
80
14s
1541
opper_lang_sv_sv_045
80
8s
1454
opper_lang_sv_sv_046
80
6s
1376
opper_lang_sv_sv_047
60
8s
1337
opper_lang_sv_sv_048
80
1m 20s
1607
opper_lang_sv_sv_049
80
11s
1659
opper_lang_sv_sv_050
80
8s
2095
opper_lang_sv_sv_051
60
7s
2128
opper_lang_sv_sv_052