Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications. Models are evaluated on their ability to provide accurate answers that are properly grounded in the given context rather than hallucinating information.

Duration

Input Tokens

6710

Output Tokens

433

Cost

$0.00

Context

Input

Based on these journals what medications are prescribed for asthma, and what are prescribed for neumonia?

Expected output

Asthma: Budesonide (inhaled corticosteroid, maintenance treatment), Salbutamol (Ventolin) (short-acting beta-agonist rescue inhaler) ; Pneumonia: Cefotaxime (IV antibiotic), Doxycycline (oral antibiotic), Amoxicillin-clavulanate (oral antibiotic after discharge)

Model output

Based on the journals:

- Medications prescribed for asthma:
  - Budesonide (inhaled corticosteroid), 200 mcg twice daily
  - Salbutamol (Ventolin, SABA), 100 mcg as needed for rescue

- Medications prescribed for pneumonia:
  - Initial: IV Cefotaxime and oral Doxycycline (inpatient)
  - Discharge: Amoxicillin-clavulanate, 875/125 mg twice daily for 5 days
  - Supportive: Paracetamol for fever and pain