Meme Understanding

Evaluates a model’s ability to interpret culture-dependent, tricky, and humor-driven content that feels obvious to humans but is hard for AI.

100
Duration
3s
Input Tokens
246
Output Tokens
246
Cost
$0.00
Context
Input
Which is heavier: a pound of feathers or a pound of steel? Give a one-sentence answer.
Expected output
{
  "answer": "They weigh the same."
}
Model output
{
  "answer": "Neither; both a pound of feathers and a pound of steel weigh the same, as they are each one pound."
}