Opper

Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications. Models are evaluated on their ability to provide accurate answers that are properly grounded in the given context rather than hallucinating information.

Context Reasoning – anthropic/claude-opus-4 Task | Opper AI

Input Tokens

0

Output Tokens

0

Duration

0

Cost

0

Context

Input

List all female characters mentioned

Expected output

Camila, Lucia, Marta, Jaya, Mum

Model output

The female characters mentioned in the journal entries are:

1. **Camila** - Don Álvaro's daughter who runs a photography studio in Cartagena, Colombia. She showed the narrator around the city and is later remembered as possibly sharing a kiss with the narrator.

2. **Lucia** - A friend of a friend in Madrid, Spain, who showed the narrator the Reina Sofía museum and various bars.

3. **Marta** - A retired photographer in San Sebastián, Spain, with whom the narrator had a long conversation.

4. **Jaya** - One of the narrator's friends in Manchester, England, who met for drinks at The Eagle pub.

5. **The narrator's mother** - Mentioned but not named (referred to as "Mum" when the narrator finds the journal in her attic).