SQL

Natural language to SQL query generation evaluates text-to-query fidelity and schema reasoning. This task is particularly relevant for analytics chat assistants and simplified database interfaces.

Duration

23s

Input Tokens

944

Output Tokens

505

Cost

$0.01

Context

Input

Show the names of customers who paid more than the average sale price for the vehicles they bought.

Expected output

SELECT c.name FROM customers c JOIN sales s ON c.customer_id = s.customer_id WHERE s.sale_price > (SELECT AVG(s2.sale_price) FROM sales s2 WHERE s2.vehicle_id = s.vehicle_id);

Model output

SELECT T1.name FROM customers AS T1 JOIN sales AS T2 ON T1.customer_id = T2.customer_id WHERE T2.sale_price > (SELECT avg(sale_price) FROM sales)