Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications. Models are evaluated on their ability to provide accurate answers that are properly grounded in the given context rather than hallucinating information.

0
Duration
17s
Input Tokens
78946
Output Tokens
158
Cost
$0.00
Context
Input
How many blogs written by Göran Sandahl are present in the context and what dates where they published.
Expected output
There are 3 blogposts by Göran Sandahl, with dates: 9/15/2024, 2/17/2025, 11/27/2024
Model output
There are two blogs written by Göran Sandahl present in the context. The first blog is dated 9/15/2024 and the second blog is dated 2/17/2025.