SQL

Natural language to SQL query generation evaluates text-to-query fidelity and schema reasoning. This task is particularly relevant for analytics chat assistants and simplified database interfaces.

Duration

Input Tokens

836

Output Tokens

117

Cost

$0.00

Context

Input

Show the names of customers who paid more than the average sale price for the vehicles they bought.

Expected output

SELECT c.name FROM customers c JOIN sales s ON c.customer_id = s.customer_id WHERE s.sale_price > (SELECT AVG(s2.sale_price) FROM sales s2 WHERE s2.vehicle_id = s.vehicle_id);

Model output

SELECT DISTINCT c.name
FROM sales s
JOIN customers c ON c.customer_id = s.customer_id
JOIN (
  SELECT vehicle_id, AVG(sale_price) AS avg_sale_price
  FROM sales
  GROUP BY vehicle_id
) a ON a.vehicle_id = s.vehicle_id
WHERE s.sale_price > a.avg_sale_price;