Meme Understanding

Evaluates a model’s ability to interpret culture-dependent, tricky, and humor-driven content that feels obvious to humans but is hard for AI.

71
fireworks/qwen3-coder-480b-a35b-instruct
Average duration
3s
Average tokens
270
Average cost
$0.00
100
3s
265
opper_memes_meme_01
100
3s
269
opper_memes_meme_02
100
3s
302
opper_memes_meme_03
100
2s
273
opper_memes_meme_04
100
3s
259
opper_memes_meme_05
100
4s
255
opper_memes_meme_06
100
3s
254
opper_memes_meme_07
100
4s
266
opper_memes_meme_08
100
2s
271
opper_memes_meme_09
100
2s
268
opper_memes_meme_10
100
2s
266
opper_memes_meme_11
0
4s
290
opper_memes_meme_12
0
8s
257
opper_memes_meme_13
0
6s
256
opper_memes_meme_14
100
2s
275
opper_memes_meme_15
100
2s
285
opper_memes_meme_16
100
2s
281
opper_memes_meme_17
0
2s
284
opper_memes_meme_18
100
2s
314
opper_memes_meme_19
0
2s
304
opper_memes_meme_20
100
2s
246
opper_memes_meme_21
0
2s
247
opper_memes_meme_22
100
2s
251
opper_memes_meme_23
0
2s
252
opper_memes_meme_24
0
2s
283
opper_memes_meme_25
100
2s
256
opper_memes_meme_26
100
2s
256
opper_memes_meme_27
100
2s
255
opper_memes_meme_28
0
2s
281
opper_memes_meme_29
100
2s
269
opper_memes_meme_30
100
14s
265
opper_memes_meme_31