Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications. Models are evaluated on their ability to provide accurate answers that are properly grounded in the given context rather than hallucinating information.

Duration

Input Tokens

3286

Output Tokens

158

Cost

$0.00

Context

Input

What was the final diagnosis given to Oscar?

Expected output

Mild persistent asthma, with a secondary diagnosis of suspected viral upper respiratory infection

Model output

The final diagnosis given to Oscar was mild persistent asthma (primary) with a secondary diagnosis of suspected viral upper respiratory infection.