Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications. Models are evaluated on their ability to provide accurate answers that are properly grounded in the given context rather than hallucinating information.

Duration

Input Tokens

5989

Output Tokens

225

Cost

$0.00

Context

Input

Carl the football player , whas diagnosed with what?

Expected output

No information about Carl's diagnosis is provided in the text.

Model output

The provided context does not mention a patient named Carl or any football player. It details two other patients: Oscar Jansson, diagnosed with mild persistent asthma (aggravated by a suspected viral upper respiratory infection), and Melisa Farrow, diagnosed with acute community-acquired pneumonia in the left lower lobe (with pleuritic chest pain). If this refers to a different scenario or there's additional context, please provide more details.