Context Reasoning

Context understanding and reasoning tasks test accurate answers grounded in provided context. This capability is essential for knowledge-base support bots, policy lookup systems, and internal knowledge Q&A applications. Models are evaluated on their ability to provide accurate answers that are properly grounded in the given context rather than hallucinating information.

Duration

Input Tokens

7383

Output Tokens

380

Cost

$0.00

Context

Input

Based on these journals what medications are prescribed for asthma, and what are prescribed for neumonia?

Expected output

Asthma: Budesonide (inhaled corticosteroid, maintenance treatment), Salbutamol (Ventolin) (short-acting beta-agonist rescue inhaler) ; Pneumonia: Cefotaxime (IV antibiotic), Doxycycline (oral antibiotic), Amoxicillin-clavulanate (oral antibiotic after discharge)

Model output

Based on the journals, the following medications were prescribed:

For Asthma (Oscar Jansson):
*   Inhaled corticosteroid (ICS): Budesonide 200 mcg, 1 puff twice daily
*   SABA (rescue): Salbutamol (Ventolin) inhaler, 100 mcg as needed (max 4x/day)
*   Paracetamol 500 mg, up to 4x/day if fever persists
*   Nasal spray (optional): Mometasone if nasal congestion develops

For Pneumonia (Melisa Farrow):
*   IV Cefotaxime 1 g every 8h
*   Oral Doxycycline 100 mg BID
*   Paracetamol 1g q6h
*   Amoxicillin-clavulanate 875/125 mg, BID for 5 more days