SQL

Natural language to SQL query generation evaluates text-to-query fidelity and schema reasoning. This task is particularly relevant for analytics chat assistants and simplified database interfaces where users need to query data using natural language. Models must understand both the intent behind the question and the structure of the underlying database schema.

50
Duration
3s
Input Tokens
634
Output Tokens
52
Cost
$0.00
Context
Input
Find all volvos
Expected output
SELECT * FROM vehicles WHERE make = 'Volvo';
Model output
SELECT vehicles.make, vehicles.model FROM vehicles;