Opper

Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications. Models are evaluated on their ability to provide accurate answers that are properly grounded in the given context rather than hallucinating information.

Context Reasoning – anthropic/claude-3.5-sonnet Task | Opper AI

Input Tokens

0

Output Tokens

0

Duration

0

Cost

0

Context

Input

What message did Oscar send to Dr. Nyström after recovering?

Expected output

He thanked her, said he was feeling much better, had resumed running, and would not need another visit for now

Model output

On June 11th, 2025, Oscar sent an SMS to Dr. Nyström thanking her for the help and informing her that he was feeling much better. He mentioned that the medication had helped significantly, he was able to go running without issues, and would continue using the inhaler as instructed. He indicated that he didn't need another visit at that time but would reach out if anything changed.