Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications.

Duration

Input Tokens

3260

Output Tokens

149

Cost

$0.02

Context

Input

Is Don Álvaros daughter called checho, true or false?

Expected output

False

Model output

False. Don Álvaro's daughter is called Camila, not Checho. Checho is the name of a parrot that the narrator later (and likely inaccurately) remembered Don Álvaro having.