Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-5131 Fine-grained Resource Configuration
  3. FLINK-5134

Aggregate ResourceSpec for chained operators when generating job graph

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.3.0
    • API / DataStream
    • None

    Description

      This is a part of fine-grained resource configuration in flip-6.

      In JobGraph generation, each JobVertex may contain a series of chained operators, and the resource of JobVertex should be aggregation of individual resource in chained operators.

      For memory resource in JobVertex, the aggregation is the sum formula for chained operators, and for cpu cores resource, the aggregation is the maximum formula for chained operators.

      Attachments

        Issue Links

          is blocked by

          Sub-task - The sub-task of the issue FLINK-5132 Introduce the ResourceSpec for grouping different resource factors in API

          • Major - Major loss of function.
          • Closed

          Sub-task - The sub-task of the issue FLINK-5133 Support to set resource for operator in DataStream and DataSet

          • Major - Major loss of function.
          • Closed
          is part of

          New Feature - A new feature of the product, which has yet to be developed. FLINK-5131 Fine-grained Resource Configuration

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #3455

          Activity

            People

              zjwang Zhijiang
              zjwang Zhijiang
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: