Meme Understanding

Evaluates a model’s ability to interpret culture-dependent, tricky, and humor-driven content that feels obvious to humans but is hard for AI.

0
Duration
3s
Input Tokens
230
Output Tokens
16
Cost
$0.00
Context
Input
How many a's in the full string 'a banana'
Expected output
{
  "count": 4
}
Model output
{
  "count": 3
}