Opper

Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications. Models are evaluated on their ability to provide accurate answers that are properly grounded in the given context rather than hallucinating information.

Input Tokens

Output Tokens

Duration

Cost

Context

Input

Return the Re-examination of the patient admitted to the hospital 2025-05-20 at 09.10

Expected output

Temperature: 38.8°C, Pulse: 102 bpm, Respiratory Rate: 22/min, O2 Sat: 93% (room air), BP: 114/68, Appearance: Pale, visibly unwell, clutching left side with each cough, Auscultation: Clear crackles LLL (Left Lower Lobe), slightly diminished breath sounds in same area, Percussion: Dullness confirmed, CRP: 98 mg/L, CBC:, WBC: 13.7 x10⁹/L (elevated), Neutrophils: 9.6 x10⁹/L, ECG: Sinus tachycardia, no ischemia, Chest X-ray (STAT reading):, Infiltrate in left lower lobe, mild pleural effusion, Consistent with community-acquired pneumonia

Model output

At the re-examination on 2025-05-20 at 09:10, Melisa Farrow presented with significant clinical deterioration: temperature 38.8°C, pulse 102 bpm, respiratory rate 22/min, O2 saturation 93% on room air, and blood pressure 114/68. She appeared pale and unwell, with clear crackles and diminished breath sounds in the left lower lobe, as well as dullness on percussion. Laboratory results showed an elevated CRP of 98 mg/L, WBC 13.7 x10⁹/L, neutrophils 9.6 x10⁹/L, and ECG revealed sinus tachycardia. A STAT chest X-ray showed a left lower lobe infiltrate and mild pleural effusion. The confirmed diagnosis was acute community-acquired pneumonia with pleuritic chest pain, requiring hospital admission for IV antibiotics and supportive care.