Opper

Agents

AI agent reasoning and tool selection tests planning, tool choice, and self-diagnosis capabilities. These skills are crucial for autonomous ticket triage systems and complex agent workflows where models must decide which tools to use, plan multi-step processes, and diagnose when things go wrong. This represents some of the most challenging tasks as they require open-ended reasoning and decision-making.

Input Tokens

Output Tokens

Duration

Cost

Context

Input

You have just received a trigger with a user request. What is the first thing you do?

Expected output

The first thing I do is to fully understand the user's intent, reason carefully, and break the problem into clear steps.

Model output

Reasoning: Let me analyze this step-by-step:

1. I've received a user request trigger where the user wants me to:
   - Add the yearly company dinner to their calendar
   - Set a reminder some days before the event
   - They mention seeing an email with more information

2. The user hasn't provided specific details like:
   - The exact date of the company dinner
   - How many days before they want the reminder
   - Which email contains the information

3. According to my instructions, I need to:
   - First fully understand the user's intent (which I've identified)
   - Break the problem into clear steps
   - When details are missing, ask the user explicitly using the user input tool
   - Always verify information before proceeding

4. The logical first step is to search for the email containing the company dinner information, as this will give me the necessary details (date, time, location) to create the calendar event.

5. I have access to the email tool with a 'search_emails' action that can help me find relevant emails about the company dinner.

Response: The first thing I do is search for the email containing information about the yearly company dinner. I would use the email tool with the 'search_emails' action, using a query like "company dinner" or "yearly dinner" to find the relevant email that contains the event details (date, time, location). This is necessary because I need these specific details before I can create the calendar event and set up the reminder as requested.