Agents

AI agent reasoning and tool selection tests planning, tool choice, and self-diagnosis capabilities. These skills are crucial for autonomous ticket triage systems and complex agent workflows where models must decide which tools to use, plan multi-step processes, and diagnose when things go wrong. This represents some of the most challenging tasks as they require open-ended reasoning and decision-making.

Duration

Input Tokens

3433

Output Tokens

135

Cost

$0.01

Context

Input

You need to list all open orders for a specific customer whose ID is `cust_42`. Which tool/method do you choose and what parameter object do you send?

Expected output

Use the **database** tool with parameters {"action": "list_orders", "customer_id": "cust_42"}.

Model output

Reasoning: Use the database tool because order data lives there. From the provided schema, listing orders for a customer uses action `list_orders` and requires `customer_id`. The prompt asks for open orders, but the available parameters for `list_orders` only include `customer_id`, so we send the valid schema-compliant object and filter for open status from returned results afterward if needed.

Response: {
  "tool": "database",
  "method": "list_orders",
  "params": {
    "action": "list_orders",
    "customer_id": "cust_42"
  }
}