[FLINK-11376] flink cli -yn -ys is not effect if (yn * ys)<parallelism ( this parallelism form env.setParallelism(parallelism) ) ;

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 1.7.1

Environment

java: jdk1.8.0_151

flink: flink-1.7.1

CDH:CDH-5.13.1-1.cdh5.13.1.p0.2

• Assignee: Unassigned
• Reporter: shengjk1
• Created: 17/Jan/19 06:49
• Updated: 18/Jan/19 02:42
• Resolved: 18/Jan/19 02:42

Description

Such as the title

if  (yn * ys)<parallelism  ( this  parallelism form env.setParallelism(parallelism) ) the yn and ys is not effect

my application is flink streaming read kafka . this kafka topic has 3 partition,and setParallelism(3) in code.when i use cli submiitjobs

flink-1.7.1/bin/flink run -m yarn-cluster -yn 1 -ys 1 -ynm test -ccom.ishansong.bigdata.Main222 ./flinkDemo-1.0-SNAPSHOT.jar

the application  apply for 4 cpu cores and 4 containers from yarn web ui

but if code is not write env.setParallelism(parallelism) or (yn*ys)>parallelism ,the  yn、ys will effect. if code write   env.setParallelism(parallelism) ，the final application resources are yn multiples and ys  multiples. such  as parallelism=10,yn=1 ys=5,the final application resources:cpu cores=11 containers=3

 

Reproduce for the convenience of bugs，offer codes