Meme Understanding

Evaluates a model’s ability to interpret culture-dependent, tricky, and humor-driven content that feels obvious to humans but is hard for AI.

81
anthropic/claude-3.7-sonnet
Average duration
3s
Average tokens
313
Average cost
$0.00
100
3s
311
opper_memes_meme_01
100
2s
314
opper_memes_meme_02
100
3s
349
opper_memes_meme_03
100
2s
320
opper_memes_meme_04
100
3s
307
opper_memes_meme_05
100
2s
299
opper_memes_meme_06
100
3s
297
opper_memes_meme_07
100
2s
308
opper_memes_meme_08
100
2s
312
opper_memes_meme_09
100
3s
311
opper_memes_meme_10
100
3s
308
opper_memes_meme_11
0
2s
331
opper_memes_meme_12
100
2s
297
opper_memes_meme_13
100
3s
295
opper_memes_meme_14
100
2s
314
opper_memes_meme_15
100
2s
329
opper_memes_meme_16
100
2s
328
opper_memes_meme_17
0
3s
326
opper_memes_meme_18
100
2s
357
opper_memes_meme_19
100
3s
357
opper_memes_meme_20
0
3s
287
opper_memes_meme_21
100
2s
288
opper_memes_meme_22
0
2s
292
opper_memes_meme_23
100
2s
292
opper_memes_meme_24
100
2s
328
opper_memes_meme_25
100
3s
296
opper_memes_meme_26
0
2s
297
opper_memes_meme_27
100
2s
295
opper_memes_meme_28
0
3s
324
opper_memes_meme_29
100
2s
314
opper_memes_meme_30
100
2s
312
opper_memes_meme_31