-
Type:
Improvement
-
Status: Closed
-
Priority:
Major
-
Resolution: Duplicate
-
Affects Version/s: 1.8.0
-
Fix Version/s: None
-
Component/s: API / DataSet, API / DataStream
-
Labels:None
-
Environment:
flink 1.8.0
jdk8
This is an example from flink-docs:
Consider a program with a data source, a MapFunction, and a ReduceFunction. The source and MapFunction are executed with a parallelism of 4, while the ReduceFunction is executed with a parallelism of 3. A pipeline consists of the sequence Source - Map - Reduce. On a cluster with 2 TaskManagers with 3 slots each, the program will be executed as described below.
But after I tried, I found that it was not like this. My result is TaskManager 1 used 3 slot, but TaskManager 2 just used 1 slot. Who else has tested this example?
- relates to
-
FLINK-11815 Support execution with static resources (Flip-6): E.g. spreading tasks across available set of TMs
-
- Open
-