[FLINK-15658] The same sql run in a streaming environment producing a Exception, but a batch env can run normally.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.10.0
• Fix Version/s: 1.10.0
• Component/s: Table SQL / Client
• Labels: pull-request-available

Environment

Input data:
tenk1 is:
4773|9990|1|1|3|13|73|773|773|4773|4773|146|147|PBAAAA|GUOAAA|OOOOxx
4093|9991|1|1|3|13|93|93|93|4093|4093|186|187|LBAAAA|HUOAAA|VVVVxx
6587|9992|1|3|7|7|87|587|587|1587|6587|174|175|JTAAAA|IUOAAA|AAAAxx
6093|9993|1|1|3|13|93|93|93|1093|6093|186|187|JAAAAA|JUOAAA|HHHHxx
429|9994|1|1|9|9|29|429|429|429|429|58|59|NQAAAA|KUOAAA|OOOOxx
5780|9995|0|0|0|0|80|780|1780|780|5780|160|161|IOAAAA|LUOAAA|VVVVxx
1783|9996|1|3|3|3|83|783|1783|1783|1783|166|167|PQAAAA|MUOAAA|AAAAxx
2992|9997|0|0|2|12|92|992|992|2992|2992|184|185|CLAAAA|NUOAAA|HHHHxx
0|9998|0|0|0|0|0|0|0|0|0|0|1|AAAAAA|OUOAAA|OOOOxx
2968|9999|0|0|8|8|68|968|968|2968|2968|136|137|EKAAAA|PUOAAA|VVVVxx

int4_tbl is:
0
123456
-123456
2147483647
-2147483647

The sql-client configuration is :

execution:
planner: blink
type: batch

• Assignee: Jark Wu
• Reporter: xiaojin.wy
• Created: 19/Jan/20 06:52
• Updated: 04/Feb/20 08:43
• Resolved: 04/Feb/20 08:43

Description

summary:
The same sql can run in a batch environment normally, but in a streaming environment there will be a exception like this:
[ERROR] Could not execute SQL statement. Reason:
org.apache.flink.table.api.ValidationException: Field names must be unique. Found duplicates: [f1]

The sql is:

CREATE TABLE `tenk1` (
unique1 int,
unique2 int,
two int,
four int,
ten int,
twenty int,
hundred int,
thousand int,
twothousand int,
fivethous int,
tenthous int,
odd int,
even int,
stringu1 varchar,
stringu2 varchar,
string4 varchar
) WITH (
'connector.path'='/daily_regression_test_stream_postgres_1.10/test_join/sources/tenk1.csv',
'format.empty-column-as-null'='true',
'format.field-delimiter'='|',
'connector.type'='filesystem',
'format.derive-schema'='true',
'format.type'='csv'
);

CREATE TABLE `int4_tbl` (
f1 INT
) WITH (
'connector.path'='/daily_regression_test_stream_postgres_1.10/test_join/sources/int4_tbl.csv',
'format.empty-column-as-null'='true',
'format.field-delimiter'='|',
'connector.type'='filesystem',
'format.derive-schema'='true',
'format.type'='csv'
);

select a.f1, b.f1, t.thousand, t.tenthous from
tenk1 t,
(select sum(f1)+1 as f1 from int4_tbl i4a) a,
(select sum(f1) as f1 from int4_tbl i4b) b
where b.f1 = t.thousand and a.f1 = b.f1 and (a.f1+b.f1+999) = t.tenthous;

Issue Links

• links to: GitHub Pull Request #11011