Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications. Models are evaluated on their ability to provide accurate answers that are properly grounded in the given context rather than hallucinating information.

Duration

Input Tokens

3203

Output Tokens

367

Cost

$0.00

Context

Input

What was Oscars response to the bronchodilator during testing?

Expected output

15% increase in FEV1, which was a positive response

Model output

Oscar had a positive response to the bronchodilator during testing, with a +15% increase in FEV1, indicating reversible airway obstruction consistent with asthma.