Meme Understanding

Evaluates a model’s ability to interpret culture-dependent, tricky, and humor-driven content that feels obvious to humans but is hard for AI.

0
Duration
2s
Input Tokens
293
Output Tokens
324
Cost
$0.00
Context
Input
Reverse this exact string: automobile
Expected output
{
  "reversed_string": "elibomotua"
}
Model output
{
  "reversed_string": "elibomotau"
}