Context Reasoning – fireworks/glm-4.5-air Task | Opper AI

Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications. Models are evaluated on their ability to provide accurate answers that are properly grounded in the given context rather than hallucinating information.

Input Tokens

0

Output Tokens

0

Duration

0

Cost

0

Context

Input

List all female characters mentioned

Expected output

Camila, Lucia, Marta, Jaya, Mum

Model output

The female characters mentioned in the text are:

1. Camila - Daughter of Don Álvaro who runs a photography studio in Cartagena, Colombia. She showed the narrator around the city.

2. Lucia - A friend of a friend in Madrid, Spain. The narrator stayed with her, and she showed them the Reina Sofía museum and many bars.

3. Marta - A retired photographer that the narrator had a conversation with in San Sebastián, Spain.

4. Jaya - One of the narrator's friends from Manchester that they met for drinks at The Eagle pub.