Meme Understanding

Evaluates a model’s ability to interpret culture-dependent, tricky, and humor-driven content that feels obvious to humans but is hard for AI.

100
Duration
2s
Input Tokens
258
Output Tokens
129
Cost
$0.00
Context
Input
Priya watches Omar put his keys in a bag. Priya steps into the hallway. While she's gone, Omar moves the keys to the desk. Where does Priya believe the keys are?
Expected output
{
  "location": "bag"
}
Model output
{
  "location": "in the bag"
}