SQL

Natural language to SQL query generation evaluates text-to-query fidelity and schema reasoning. This task is particularly relevant for analytics chat assistants and simplified database interfaces where users need to query data using natural language. Models must understand both the intent behind the question and the structure of the underlying database schema.

100
Duration
23s
Input Tokens
836
Output Tokens
987
Cost
$0.00
Context
Input
Find the name of the dealership that has the highest total revenue from vehicle sales
Expected output
SELECT d.name FROM dealerships d JOIN sales s ON d.branch_id = s.branch_id GROUP BY d.name ORDER BY SUM(s.sale_price) DESC LIMIT 1;
Model output
SELECT T2.name FROM sales AS T1 INNER JOIN dealerships AS T2 ON T1.branch_id = T2.branch_id GROUP BY T2.name ORDER BY SUM(T1.sale_price) DESC LIMIT 1;