Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications. Models are evaluated on their ability to provide accurate answers that are properly grounded in the given context rather than hallucinating information.

100
Duration
20s
Input Tokens
5892
Output Tokens
446
Cost
$0.00
Context
Input
Based on these journals what medications are prescribed for asthma, and what are prescribed for neumonia?
Expected output
Asthma: Budesonide (inhaled corticosteroid, maintenance treatment), Salbutamol (Ventolin) (short-acting beta-agonist rescue inhaler) ; Pneumonia: Cefotaxime (IV antibiotic), Doxycycline (oral antibiotic), Amoxicillin-clavulanate (oral antibiotic after discharge)
Model output
Based on the provided patient journals, the medications prescribed are as follows:

For asthma (Oscar Jansson):
- Inhaled corticosteroid (ICS): Budesonide 200 mcg, 1 puff twice daily
- Short-acting beta-agonist (SABA, rescue inhaler): Salbutamol (Ventolin) inhaler, 100 mcg as needed (maximum 4 times a day)
- Antipyretic: Paracetamol 500 mg, up to 4 times daily if fever persists
- Nasal spray (optional): Mometasone if nasal congestion develops

For pneumonia (Melisa Farrow):
- Intravenous antibiotics: Cefotaxime 1 g every 8 hours
- Oral antibiotic: Doxycycline 100 mg twice daily
- Follow-up oral antibiotic after discharge: Amoxicillin-clavulanate 875/125 mg twice daily for 5 more days
- Supportive medication: Paracetamol 500 mg as needed for fever and pain

No asthma medications were prescribed for the pneumonia case, and no antibiotics were prescribed for the asthma case at any stage other than supportive or rescue medications for asthma symptoms.