Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications. Models are evaluated on their ability to provide accurate answers that are properly grounded in the given context rather than hallucinating information.

Duration

Input Tokens

2799

Output Tokens

139

Cost

$0.00

Context

Input

List all female characters mentioned

Expected output

Camila, Lucia, Marta, Jaya, Mum

Model output

The female characters mentioned are: Camila (Don Álvaro's daughter), Lucia (friend in Madrid), Marta (retired photographer in San Sebastián), and Jaya (friend from Manchester).