Meme Understanding

Evaluates a model’s ability to interpret culture-dependent, tricky, and humor-driven content that feels obvious to humans but is hard for AI.

100
Duration
4s
Input Tokens
261
Output Tokens
136
Cost
$0.00
Context
Input
Repeat back exactly this text (including spacing/punctuation): Numbers: 1, 2, 3, 4, 5 — all in order.
Expected output
{
  "repeated_text": "Numbers: 1, 2, 3, 4, 5 — all in order."
}
Model output
{
  "repeated_text": "Numbers: 1, 2, 3, 4, 5 — all in order."
}