Swedish Language Understanding

Multilingual comprehension and reasoning in Swedish, covering fact checking, summarization, inference, literary and legal analysis, and dialectal understanding. This task evaluates how well models follow Swedish instructions and produce accurate, well-formed answers in Swedish.

81
gcp/gemini-flash-latest
Average duration
8s
Average tokens
2586
Average cost
$0.00
80
6s
1493
opper_lang_sv_sv_001
100
3s
927
opper_lang_sv_sv_002
100
3s
846
opper_lang_sv_sv_003
100
3s
824
opper_lang_sv_sv_004
100
6s
1590
opper_lang_sv_sv_005
100
2s
892
opper_lang_sv_sv_006
60
11s
3087
opper_lang_sv_sv_007
80
7s
2582
opper_lang_sv_sv_008
80
5s
2175
opper_lang_sv_sv_009
80
8s
2812
opper_lang_sv_sv_010
80
5s
1974
opper_lang_sv_sv_011
80
7s
2271
opper_lang_sv_sv_012
80
7s
2291
opper_lang_sv_sv_013
80
8s
2619
opper_lang_sv_sv_014
100
8s
2450
opper_lang_sv_sv_015
80
8s
2682
opper_lang_sv_sv_016
80
13s
3276
opper_lang_sv_sv_017
60
5s
2058
opper_lang_sv_sv_018
60
9s
2588
opper_lang_sv_sv_019
80
12s
3114
opper_lang_sv_sv_020
80
11s
3178
opper_lang_sv_sv_021
80
9s
2798
opper_lang_sv_sv_022
80
10s
3121
opper_lang_sv_sv_023
80
8s
2768
opper_lang_sv_sv_024
80
8s
2695
opper_lang_sv_sv_025
80
6s
2543
opper_lang_sv_sv_026
80
7s
2603
opper_lang_sv_sv_027
60
6s
2331
opper_lang_sv_sv_028
80
6s
2326
opper_lang_sv_sv_029
80
5s
2119
opper_lang_sv_sv_030
80
11s
3122
opper_lang_sv_sv_031
80
7s
2427
opper_lang_sv_sv_032
80
6s
2354
opper_lang_sv_sv_033
80
8s
2896
opper_lang_sv_sv_034
80
10s
2970
opper_lang_sv_sv_035
60
10s
3107
opper_lang_sv_sv_036
80
8s
2766
opper_lang_sv_sv_037
60
13s
3347
opper_lang_sv_sv_038
80
8s
2778
opper_lang_sv_sv_039
80
11s
3101
opper_lang_sv_sv_040
80
7s
2558
opper_lang_sv_sv_041
60
8s
2844
opper_lang_sv_sv_042
80
10s
2871
opper_lang_sv_sv_043
80
6s
2207
opper_lang_sv_sv_044
100
11s
3298
opper_lang_sv_sv_045
80
9s
2876
opper_lang_sv_sv_046
100
11s
3014
opper_lang_sv_sv_047
80
11s
3194
opper_lang_sv_sv_048
100
9s
3004
opper_lang_sv_sv_049
100
7s
2709
opper_lang_sv_sv_050
100
13s
4285
opper_lang_sv_sv_051
60
9s
3691
opper_lang_sv_sv_052