[FLINK-8712] Cannot execute job with multiple slot sharing groups on LocalExecutor

• Type: Bug
• Status: Closed
• Priority: Not a Priority
• Resolution: Won't Fix
• Affects Version/s: 1.5.0
• Component/s: Runtime / Task
• Labels: auto-deprioritized-critical auto-deprioritized-major auto-deprioritized-minor
• Assignee: Unassigned
• Reporter: Till Rohrmann
• Created: 20/Feb/18 10:11
• Updated: 17/Nov/22 08:14
• Resolved: 17/Nov/22 08:14

Description

Currently, it is not possible to run a job with multiple slot sharing groups on the LocalExecutor. The problem is that we determine the number of required slots simply by looking for the max parallelism of the job but do not consider slot sharing groups.

 

// set up the streaming execution environment
final StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();

env.setParallelism(1);

final DataStreamSource<Integer> input = env.addSource(new InfinitySource());

final SingleOutputStreamOperator<Integer> different = input.map(new MapFunction<Integer, Integer>() {
   @Override
   public Integer map(Integer integer) throws Exception {
      return integer;
   }
}).slotSharingGroup("Different");

different.print();

// execute program
env.execute("Flink Streaming Java API Skeleton");

Issue Links

• is related to: FLINK-8711 Flink with YARN uses wrong SlotsPerTaskManager