Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications. Models are evaluated on their ability to provide accurate answers that are properly grounded in the given context rather than hallucinating information.

Duration

Input Tokens

5997

Output Tokens

395

Cost

$0.00

Context

Input

Based on these journals what medications are prescribed for asthma, and what are prescribed for neumonia?

Expected output

Asthma: Budesonide (inhaled corticosteroid, maintenance treatment), Salbutamol (Ventolin) (short-acting beta-agonist rescue inhaler) ; Pneumonia: Cefotaxime (IV antibiotic), Doxycycline (oral antibiotic), Amoxicillin-clavulanate (oral antibiotic after discharge)

Model output

Based on the journals:

**Medications prescribed for asthma** (from Oscar Jansson's journal):
- Inhaled corticosteroid (ICS): Budesonide 200 mcg, 1 puff twice daily
- Short-acting beta-agonist (SABA, rescue inhaler): Salbutamol (Ventolin) 100 mcg as needed (max 4x/day)

(Note: Paracetamol was also prescribed for associated fever from a secondary viral infection, but it is symptomatic and not specific to asthma.)

**Medications prescribed for pneumonia** (from Melisa Farrow's journal):
- Initial inpatient treatment: IV Cefotaxime 1 g every 8 hours + Oral Doxycycline 100 mg twice daily
- Discharge/outpatient: Amoxicillin-clavulanate 875/125 mg twice daily for 5 days
- Supportive: Paracetamol 1 g every 6 hours (or 500 mg as needed) for fever and pain

(Note: No pneumonia-specific medications appear in the asthma journal, and the cases are distinct.)