Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications. Models are evaluated on their ability to provide accurate answers that are properly grounded in the given context rather than hallucinating information.

0
Duration
8s
Input Tokens
3339
Output Tokens
231
Cost
$0.00
Context
Input
Who owned a machete?
Expected output
Joaquín
Model output
Don Alvaro, the owner of the store where the context's author bought wooden jaguar and a bottle of cinnamon-tasting liquid, owned a machete.