Meme Understanding

Evaluates a model’s ability to interpret culture-dependent, tricky, and humor-driven content that feels obvious to humans but is hard for AI.

58
fireworks/deepseek-v3.1
Average duration
10s
Average tokens
283
Average cost
$0.00
100
3s
263
opper_memes_meme_01
100
2s
269
opper_memes_meme_02
100
2s
300
opper_memes_meme_03
0
2s
271
opper_memes_meme_04
100
2s
256
opper_memes_meme_05
100
1s
252
opper_memes_meme_06
100
2s
252
opper_memes_meme_07
100
2s
258
opper_memes_meme_08
100
1s
263
opper_memes_meme_09
100
2s
260
opper_memes_meme_10
100
2s
259
opper_memes_meme_11
0
1s
279
opper_memes_meme_12
100
1s
249
opper_memes_meme_13
100
2s
249
opper_memes_meme_14
100
2s
277
opper_memes_meme_15
100
38s
667
opper_memes_meme_16
100
2s
276
opper_memes_meme_17
0
2s
280
opper_memes_meme_18
100
1m 38s
499
opper_memes_meme_19
0
3s
305
opper_memes_meme_20
100
14s
240
opper_memes_meme_21
0
2s
241
opper_memes_meme_22
0
2s
245
opper_memes_meme_23
0
2s
245
opper_memes_meme_24
0
1s
282
opper_memes_meme_25
100
1m 42s
250
opper_memes_meme_26
0
2s
251
opper_memes_meme_27
0
2s
249
opper_memes_meme_28
0
2s
278
opper_memes_meme_29
0
2s
261
opper_memes_meme_30
0
1s
259
opper_memes_meme_31