Meme Understanding

Evaluates a model’s ability to interpret culture-dependent, tricky, and humor-driven content that feels obvious to humans but is hard for AI.

0
Duration
3s
Input Tokens
347
Output Tokens
46
Cost
$0.00
Context
Input
Output this token exactly once: TheNitrome
Expected output
{
  "token": "TheNitrome"
}
Model output
{
  "token": "TheNitrome<budget:token_budget>200000</budget:token_budget>"
}