Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

80
openai/o3
Average duration
19s
Average tokens
1689
Average cost
$0.00
80
1m 24s
822
opper_lang_sv_sv_001
80
7s
836
opper_lang_sv_sv_002
100
1m 15s
766
opper_lang_sv_sv_003
100
6s
678
opper_lang_sv_sv_004
80
7s
837
opper_lang_sv_sv_005
100
7s
861
opper_lang_sv_sv_006
80
11s
1837
opper_lang_sv_sv_007
80
9s
1595
opper_lang_sv_sv_008
100
8s
1546
opper_lang_sv_sv_009
80
10s
1640
opper_lang_sv_sv_010
100
9s
1404
opper_lang_sv_sv_011
80
8s
1390
opper_lang_sv_sv_012
40
11s
1416
opper_lang_sv_sv_013
100
17s
1929
opper_lang_sv_sv_014
100
12s
1615
opper_lang_sv_sv_015
80
1m 9s
1557
opper_lang_sv_sv_016
80
11s
1666
opper_lang_sv_sv_017
80
9s
1476
opper_lang_sv_sv_018
80
10s
1755
opper_lang_sv_sv_019
100
11s
1648
opper_lang_sv_sv_020
80
1m 22s
1934
opper_lang_sv_sv_021
80
11s
1934
opper_lang_sv_sv_022
80
11s
1985
opper_lang_sv_sv_023
80
1m 7s
2046
opper_lang_sv_sv_024
80
12s
1813
opper_lang_sv_sv_025
80
1m 24s
1838
opper_lang_sv_sv_026
80
8s
1615
opper_lang_sv_sv_027
80
11s
1756
opper_lang_sv_sv_028
80
13s
1821
opper_lang_sv_sv_029
80
9s
1527
opper_lang_sv_sv_030
50
16s
2401
opper_lang_sv_sv_031
100
13s
1987
opper_lang_sv_sv_032
80
6s
1612
opper_lang_sv_sv_033
50
8s
1792
opper_lang_sv_sv_034
80
9s
1808
opper_lang_sv_sv_035
80
9s
1859
opper_lang_sv_sv_036
80
10s
1615
opper_lang_sv_sv_037
60
13s
2289
opper_lang_sv_sv_038
40
6s
1539
opper_lang_sv_sv_039
80
11s
1904
opper_lang_sv_sv_040
80
9s
1782
opper_lang_sv_sv_041
50
10s
1856
opper_lang_sv_sv_042
80
10s
1730
opper_lang_sv_sv_043
80
9s
1548
opper_lang_sv_sv_044
80
10s
1768
opper_lang_sv_sv_045
80
8s
1742
opper_lang_sv_sv_046
80
8s
1609
opper_lang_sv_sv_047
80
1m 11s
1923
opper_lang_sv_sv_048
80
11s
1976
opper_lang_sv_sv_049
100
13s
2145
opper_lang_sv_sv_050
80
12s
2673
opper_lang_sv_sv_051
80
12s
2707
opper_lang_sv_sv_052