SQL

Natural language to SQL query generation evaluates text-to-query fidelity and schema reasoning. This task is particularly relevant for analytics chat assistants and simplified database interfaces.

Duration

Input Tokens

654

Output Tokens

226

Cost

$0.00

Context

Input

Count the number of vehicles.

Expected output

SELECT COUNT(*) FROM vehicles;

Model output

SELECT COUNT(vehicle_id) FROM vehicles;