Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Won't Fix
-
1.10.0, 1.10.1
-
None
-
None
-
ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();
EnviromentSettings streamSettings = EnviromentSetting.newInstance().useBlinkPlanner().inStreamingMode().build();
TableEnviroment tEnv = TableEnviroment.create(streamSettings);
env.setParallelism(1);
CREATE TABLE source(
...
)WITH(
'connector.type' = 'filesystem',
...
)ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment(); EnviromentSettings streamSettings = EnviromentSetting.newInstance().useBlinkPlanner().inStreamingMode().build(); TableEnviroment tEnv = TableEnviroment.create(streamSettings); env.setParallelism(1); CREATE TABLE source( ... )WITH( 'connector.type' = 'filesystem', ... )
Description
using filesystem batch write csv data to file, we set parallelism to 1, but output more than one (defaultLocalParallelism). There is no such problem when writing with streams.