Meme Understanding

Evaluates a model’s ability to interpret culture-dependent, tricky, and humor-driven content that feels obvious to humans but is hard for AI.

100
Duration
2s
Input Tokens
249
Output Tokens
21
Cost
$0.00
Context
Input
Answer with YES only if the sentence contains no negation; otherwise NO. Sentence: When he entered his room the door was not closed
Expected output
{
  "answer": "NO"
}
Model output
{
  "answer": "NO"
}