SQL

Natural language to SQL query generation evaluates text-to-query fidelity and schema reasoning. This task is particularly relevant for analytics chat assistants and simplified database interfaces where users need to query data using natural language. Models must understand both the intent behind the question and the structure of the underlying database schema.

88
gcp/gemini-flash-lite-latest
Average duration
2s
Average tokens
1257
Average cost
$0.00
100
3s
788
opper_sql_sample_01
100
3s
820
opper_sql_sample_02
100
2s
795
opper_sql_sample_03
100
2s
806
opper_sql_sample_04
100
2s
857
opper_sql_sample_05
100
2s
881
opper_sql_sample_06
100
2s
791
opper_sql_sample_07
100
2s
795
opper_sql_sample_08
100
2s
814
opper_sql_sample_09
100
2s
837
opper_sql_sample_10
100
2s
1031
opper_sql_sample_11
100
2s
1084
opper_sql_sample_12
75
2s
1111
opper_sql_sample_13
100
2s
1148
opper_sql_sample_14
100
2s
1163
opper_sql_sample_15
50
4s
2281
opper_sql_sample_16
100
2s
1132
opper_sql_sample_17
75
2s
1260
opper_sql_sample_18
50
3s
1210
opper_sql_sample_19
100
2s
1274
opper_sql_sample_20
100
3s
1246
opper_sql_sample_21
100
2s
1361
opper_sql_sample_22
75
2s
1404
opper_sql_sample_23
50
2s
1444
opper_sql_sample_24
50
2s
1597
opper_sql_sample_25
100
2s
1366
opper_sql_sample_26
50
3s
1788
opper_sql_sample_27
100
2s
1488
opper_sql_sample_28
50
8s
3903
opper_sql_sample_29
100
2s
1242
opper_sql_sample_30