Opper

Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications. Models are evaluated on their ability to provide accurate answers that are properly grounded in the given context rather than hallucinating information.

Context Reasoning – anthropic/claude-3.5-haiku Task | Opper AI

Input Tokens

0

Output Tokens

0

Duration

0

Cost

0

Context

Input

What message did Oscar send to Dr. Nyström after recovering?

Expected output

He thanked her, said he was feeling much better, had resumed running, and would not need another visit for now

Model output

After recovering, Oscar sent a text message (SMS) to Dr. Nyström on 2025-06-11, thanking her for her help. In the message, he noted that the medication has helped a lot, he was feeling much better, had gone running without issues, and would continue with the inhaler as instructed. He also mentioned no need for another visit at that time.