Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

69
openai/o3-mini
Average duration
19s
Average tokens
1864
Average cost
$0.00
80
8s
1043
opper_lang_sv_sv_001
100
6s
824
opper_lang_sv_sv_002
100
6s
758
opper_lang_sv_sv_003
100
7s
798
opper_lang_sv_sv_004
80
10s
1163
opper_lang_sv_sv_005
100
8s
860
opper_lang_sv_sv_006
80
1m 28s
2268
opper_lang_sv_sv_007
80
57s
1918
opper_lang_sv_sv_008
60
7s
1605
opper_lang_sv_sv_009
60
13s
2153
opper_lang_sv_sv_010
80
7s
1391
opper_lang_sv_sv_011
80
10s
1656
opper_lang_sv_sv_012
40
10s
1615
opper_lang_sv_sv_013
80
10s
1752
opper_lang_sv_sv_014
50
10s
1634
opper_lang_sv_sv_015
80
11s
1861
opper_lang_sv_sv_016
60
12s
1743
opper_lang_sv_sv_017
80
12s
1887
opper_lang_sv_sv_018
40
12s
1977
opper_lang_sv_sv_019
80
8s
1694
opper_lang_sv_sv_020
80
12s
2144
opper_lang_sv_sv_021
50
12s
1985
opper_lang_sv_sv_022
50
19s
1910
opper_lang_sv_sv_023
80
10s
2012
opper_lang_sv_sv_024
60
11s
2063
opper_lang_sv_sv_025
50
10s
1806
opper_lang_sv_sv_026
80
10s
1622
opper_lang_sv_sv_027
80
11s
2042
opper_lang_sv_sv_028
80
45s
1930
opper_lang_sv_sv_029
80
11s
1867
opper_lang_sv_sv_030
50
58s
1879
opper_lang_sv_sv_031
80
10s
1859
opper_lang_sv_sv_032
80
9s
1741
opper_lang_sv_sv_033
80
1m 37s
1750
opper_lang_sv_sv_034
80
12s
1973
opper_lang_sv_sv_035
40
16s
2821
opper_lang_sv_sv_036
40
13s
2341
opper_lang_sv_sv_037
100
16s
2711
opper_lang_sv_sv_038
40
12s
1922
opper_lang_sv_sv_039
50
11s
1876
opper_lang_sv_sv_040
50
10s
1796
opper_lang_sv_sv_041
20
11s
2041
opper_lang_sv_sv_042
60
9s
1807
opper_lang_sv_sv_043
80
1m 23s
1836
opper_lang_sv_sv_044
80
1m 2s
1939
opper_lang_sv_sv_045
60
7s
1763
opper_lang_sv_sv_046
40
17s
2753
opper_lang_sv_sv_047
60
11s
2190
opper_lang_sv_sv_048
80
14s
2434
opper_lang_sv_sv_049
100
10s
2157
opper_lang_sv_sv_050
80
10s
2616
opper_lang_sv_sv_051
60
11s
2750
opper_lang_sv_sv_052