SQL

Natural language to SQL query generation evaluates text-to-query fidelity and schema reasoning. This task is particularly relevant for analytics chat assistants and simplified database interfaces.

Duration

1m 17s

Input Tokens

560

Output Tokens

431

Cost

$0.01

Context

Input

Count the number of vehicles.

Expected output

SELECT COUNT(*) FROM vehicles;

Model output

SELECT COUNT(*) AS total_vehicles FROM vehicles;