Agents

AI agent reasoning and tool selection tests planning, tool choice, and self-diagnosis capabilities. These skills are crucial for autonomous ticket triage systems and complex agent workflows where models must decide which tools to use, plan multi-step processes, and diagnose when things go wrong. This represents some of the most challenging tasks as they require open-ended reasoning and decision-making.

1 **calendar.get_current_date** → {"action": "get_current_date"} 1b **memory.store_item** → {"action": "store_item", "key": "current_date", "value": "<current_date_result>"} 2 **calendar.add_business_days** → {"action": "add_business_days", "start_date": "<current_date>", "days_to_add": 2} 2b **memory.store_item** → {"action": "store_item", "key": "target_date", "value": "<result_from_add_business_days>"} 3 **calendar.format_date** → {"action": "format_date", "date": "<target_date>T09:00:00", "format": "YYYY-MM-DDTHH:mm:ssZ"} 3b **memory.store_item** → {"action": "store_item", "key": "formatted_send_time", "value": "<formatted_datetime_result>"} 4 **email.draft_email** → {"action": "draft_email", "to": "<customer_email>", "subject": "Address Update Confirmation", "body": "<confirmation_message>"} 4b **memory.store_item** → {"action": "store_item", "key": "draft_id", "value": "<draft_email_id>"} 5 **email.schedule_email** → {"action": "schedule_email", "draft_id": "<draft_id>", "send_at": "<formatted_send_time>"} 5b **memory.store_item** → {"action": "store_item", "key": "scheduled_email", "value": "Email scheduled for <formatted_send_time>"}

Reasoning: High-level plan: determine the target send date by adding 2 business days to today, then prepare a follow-up email and schedule it for 09:00 on that date. Use the calendar tool to compute dates, the database tool to fetch recipient details (if needed), the email tool to draft and schedule the message, and memory to log the scheduling details. If required data is missing (e.g., recipient), plan to fetch it from the database or request clarification before sending. Response: Tool sequence and key parameters: 1) calendar.get_current_date - action: 'get_current_date' - (no additional parameters) - Returns: current_date (ISO-8601 date, e.g., 2025-08-07) 2) calendar.add_business_days - action: 'add_business_days' - start_date: '<current_date>' (value from step 1) - days_to_add: 2 - Returns: target_date (YYYY-MM-DD, e.g., 2025-08-11) 3) database.get_customer - action: 'get_customer' - customer_id: '<customer_id>' - Returns: recipient_name, recipient_email 4) email.draft_email - action: 'draft_email' - to: '<recipient_email>' - subject: 'Follow-up: Confirmation for your ticket' - body: 'Hello <Name>,\n\nThis is a follow-up to confirm your ticket. We will send a follow-up confirmation at 09:00 on <target_date>. If you have any questions, please reply to this email.\n\nBest regards,\n[Your Name]' - Returns: draft_id 5) email.schedule_email - action: 'schedule_email' - draft_id: '<draft_id>' (from step 4) - send_at: '<target_date>T09:00:00<timezone_offset>' (ISO-8601, e.g., 2025-08-11T09:00:00-04:00) - Returns: scheduled_email_id 6) memory.store_item - action: 'store_item' - key: 'email_schedule' - value: '{"draft_id":"<draft_id>","recipient_email":"<recipient_email>","send_at":"<send_at>"}'

Agents

Context

Input

Expected output

Model output