Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications. Models are evaluated on their ability to provide accurate answers that are properly grounded in the given context rather than hallucinating information.

Duration

Input Tokens

5954

Output Tokens

685

Cost

$0.00

Context

Input

Based on these journals what medications are prescribed for asthma, and what are prescribed for neumonia?

Expected output

Asthma: Budesonide (inhaled corticosteroid, maintenance treatment), Salbutamol (Ventolin) (short-acting beta-agonist rescue inhaler) ; Pneumonia: Cefotaxime (IV antibiotic), Doxycycline (oral antibiotic), Amoxicillin-clavulanate (oral antibiotic after discharge)

Model output

Asthma (Oscar Jansson):
- Inhaled corticosteroid (ICS): Budesonide 200 mcg, 1 puff twice daily
- Short‑acting β₂‑agonist (SABA): Salbutamol (Ventolin) 100 mcg as needed (max 4×/day)
- Antipyretic: Paracetamol 500 mg, up to 4×/day if fever persists
- Optional nasal spray: Mometasone (if nasal congestion develops)

Pneumonia (Melisa Farrow):
- Initial inpatient therapy:
  - IV Cefotaxime 1 g every 8 h
  - Oral Doxycycline 100 mg BID (for atypical coverage)
  - Paracetamol 1 g q6 h for fever/pain
  - IV fluids and oxygen (2 L/min) as needed
- Discharge oral regimen:
  - Amoxicillin‑clavulanate 875/125 mg BID for 5 days
  - Paracetamol 500 mg as needed
  - No ibuprofen during infection