SQL

Natural language to SQL query generation evaluates text-to-query fidelity and schema reasoning. This task is particularly relevant for analytics chat assistants and simplified database interfaces.

Duration

14s

Input Tokens

942

Output Tokens

246

Cost

$0.00

Context

Input

Show the total sales revenue (total_revenue) per branch (branch_name)

Expected output

SELECT d.name AS branch_name, SUM(s.sale_price) AS total_revenue FROM sales s JOIN dealerships d ON s.branch_id = d.branch_id GROUP BY d.name;

Model output

SELECT dealerships.name AS branch_name, SUM(sales.sale_price) AS total_revenue FROM dealerships JOIN sales ON dealerships.branch_id = sales.branch_id GROUP BY dealerships.name;