Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications. Models are evaluated on their ability to provide accurate answers that are properly grounded in the given context rather than hallucinating information.

Duration

Input Tokens

8269

Output Tokens

203

Cost

$0.00

Context

Input

Which patient had to be accepted in the hospital?

Expected output

Melisa Farrow

Model output

Oscar Jansson was accepted in the hospital due to breathing issues which led to the diagnosis of mild persistent asthma, likely aggravated by an upper respiratory viral infection or allergic response. Melisa Farrow was also accepted in the hospital due to acute community-acquired pneumonia in the left lower lobe with pleuritic chest pain.