Swedish Language Understanding

How well models follow Swedish instructions and produce well-formed Swedish answers — covering disambiguation, summarisation, inference, and dialectal nuance.

82
gcp/gemini-3.1-pro-preview
Average duration
30s
Average tokens
2195
Average cost
$0.01
80
14s
1265
opper_lang_sv_sv_001
100
10s
1183
opper_lang_sv_sv_002
100
26s
1055
opper_lang_sv_sv_003
100
36s
1044
opper_lang_sv_sv_004
80
12s
1321
opper_lang_sv_sv_005
100
7s
1040
opper_lang_sv_sv_006
80
42s
2645
opper_lang_sv_sv_007
80
11s
2239
opper_lang_sv_sv_008
80
10s
2026
opper_lang_sv_sv_009
80
13s
2527
opper_lang_sv_sv_010
100
19s
1852
opper_lang_sv_sv_011
80
12s
2004
opper_lang_sv_sv_012
80
10s
1765
opper_lang_sv_sv_013
100
34s
2387
opper_lang_sv_sv_014
100
11s
2266
opper_lang_sv_sv_015
80
11s
2206
opper_lang_sv_sv_016
80
1m 5s
2232
opper_lang_sv_sv_017
80
53s
1888
opper_lang_sv_sv_018
60
52s
2304
opper_lang_sv_sv_019
80
33s
2399
opper_lang_sv_sv_020
80
22s
2280
opper_lang_sv_sv_021
80
36s
2295
opper_lang_sv_sv_022
80
29s
2617
opper_lang_sv_sv_023
100
14s
2398
opper_lang_sv_sv_024
80
10s
2167
opper_lang_sv_sv_025
60
23s
2080
opper_lang_sv_sv_026
80
1m 32s
2082
opper_lang_sv_sv_027
60
31s
2122
opper_lang_sv_sv_028
80
17s
2118
opper_lang_sv_sv_029
80
9s
1921
opper_lang_sv_sv_030
80
15s
2694
opper_lang_sv_sv_031
60
10s
2080
opper_lang_sv_sv_032
80
11s
2198
opper_lang_sv_sv_033
80
17s
2288
opper_lang_sv_sv_034
80
56s
2240
opper_lang_sv_sv_035
40
42s
2645
opper_lang_sv_sv_036
80
45s
2488
opper_lang_sv_sv_037
80
21s
2774
opper_lang_sv_sv_038
100
58s
2181
opper_lang_sv_sv_039
80
33s
2535
opper_lang_sv_sv_040
80
38s
2166
opper_lang_sv_sv_041
80
25s
2443
opper_lang_sv_sv_042
80
32s
2424
opper_lang_sv_sv_043
80
22s
1878
opper_lang_sv_sv_044
80
29s
2763
opper_lang_sv_sv_045
80
11s
2305
opper_lang_sv_sv_046
80
1m 36s
2267
opper_lang_sv_sv_047
80
1m 58s
2185
opper_lang_sv_sv_048
80
39s
2416
opper_lang_sv_sv_049
100
43s
2414
opper_lang_sv_sv_050
80
22s
3502
opper_lang_sv_sv_051
80
15s
3513
opper_lang_sv_sv_052