SQL

Natural language to SQL query generation evaluates text-to-query fidelity and schema reasoning. This task is particularly relevant for analytics chat assistants and simplified database interfaces where users need to query data using natural language. Models must understand both the intent behind the question and the structure of the underlying database schema.

81
gcp/gemini-2.0-flash-lite
Average duration
11s
Average tokens
949
Average cost
$0.00
75
16s
632
opper_sql_sample_01
75
14s
663
opper_sql_sample_02
100
14s
663
opper_sql_sample_03
75
13s
653
opper_sql_sample_04
100
9s
705
opper_sql_sample_05
100
16s
748
opper_sql_sample_06
100
16s
643
opper_sql_sample_07
75
13s
644
opper_sql_sample_08
100
13s
663
opper_sql_sample_09
100
16s
755
opper_sql_sample_10
75
8s
882
opper_sql_sample_11
75
16s
916
opper_sql_sample_12
75
8s
943
opper_sql_sample_13
100
13s
950
opper_sql_sample_14
75
13s
995
opper_sql_sample_15
75
7s
1018
opper_sql_sample_16
100
7s
958
opper_sql_sample_17
75
7s
1092
opper_sql_sample_18
50
13s
963
opper_sql_sample_19
100
13s
1213
opper_sql_sample_20
100
10s
1117
opper_sql_sample_21
75
13s
1185
opper_sql_sample_22
75
13s
1286
opper_sql_sample_23
75
13s
1193
opper_sql_sample_24
100
13s
1180
opper_sql_sample_25
75
8s
1151
opper_sql_sample_26
50
8s
1131
opper_sql_sample_27
75
8s
1253
opper_sql_sample_28
0
5s
1161
opper_sql_sample_29
100
5s
1103
opper_sql_sample_30