Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-12921

Flink Job Scheduling

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 1.8.0
    • Fix Version/s: None
    • Component/s: API / DataSet, API / DataStream
    • Labels:
      None
    • Environment:

      flink 1.8.0

      jdk8

      Description

      This is an example from flink-docs:

      Consider a program with a data source, a MapFunction, and a ReduceFunction. The source and MapFunction are executed with a parallelism of 4, while the ReduceFunction is executed with a parallelism of 3. A pipeline consists of the sequence Source - Map - Reduce. On a cluster with 2 TaskManagers with 3 slots each, the program will be executed as described below.

      But after I tried, I found that it was not like this. My result is TaskManager 1 used 3 slot, but TaskManager 2 just used 1 slot. Who else has tested this example?

        Attachments

          Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-11815 Support execution with static resources (Flip-6): E.g. spreading tasks across available set of TMs

          • Major - Major loss of function.
          • Open

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                vim vim
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: