Opper

Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications. Models are evaluated on their ability to provide accurate answers that are properly grounded in the given context rather than hallucinating information.

Context Reasoning – anthropic/claude-sonnet-4 Task | Opper AI

Input Tokens

0

Output Tokens

0

Duration

0

Cost

0

Context

Input

List all female characters mentioned

Expected output

Camila, Lucia, Marta, Jaya, Mum

Model output

The female characters mentioned by name in the journal entries are:

1. **Camila** - Don Álvaro's daughter who runs a photography studio in Cartagena and showed the narrator around the city
2. **Lucia** - A friend of a friend who the narrator stayed with in Madrid and who showed them around museums and bars
3. **Marta** - A retired photographer the narrator had a conversation with in San Sebastián
4. **Jaya** - A friend who met the narrator for drinks at The Eagle pub in Manchester
5. **Mum** - The narrator's mother, mentioned when the narrator found the journal in her attic