GitHub user zhijiangW opened a pull request:
FLINK-5134[runtime]Aggregate ResourceSpe for chained operators when generating JobGraph
It is a part of fine-grained resource configuration in 'flip-6'.
In 'JobGraph' generation, each created 'JobVertex' may contain a series of chained operators, and the resource of 'JobVertex' should be aggregation of individual resource in chained operators.
BTW, in order to avoid NPE issue and take it easy to process in the following processes, I set the default unknown 'ResourceSpec' for 'Operator' and 'StreamNode'.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zhijiangW/flink FLILNK-5134
Alternatively you can review and apply these changes as the patch at:
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3455
Author: 淘江 <email@example.com>
FLINK-5134[runtime]Aggregate ResourceSpe for chained operators when generating job graph
Summary: It is a sub task of fine-grained resource configuration. Aggregate ResourceSpe for chained operators when generating job graph
Test Plan: N/A
Differential Revision: https://aone.alibaba-inc.com/code/D124138