Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications. Models are evaluated on their ability to provide accurate answers that are properly grounded in the given context rather than hallucinating information.

0
Duration
3s
Input Tokens
6701
Output Tokens
326
Cost
$0.00
Context
Input
Carl the football player , whas diagnosed with what?
Expected output
No information about Carl's diagnosis is provided in the text.
Model output
There is no information about a patient named Carl in the provided context. The records describe Oscar Jansson with mild persistent asthma and Melisa Farrow with community-acquired pneumonia. Neither of these diagnoses applies to Carl as no data about him is present.