Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-11148

Rescaling operator regression in Flink 1.7

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 1.7.0
    • Fix Version/s: None
    • Component/s: Runtime / Coordination
    • Labels:
      None

      Description

      We have a job using 20 TaskManager with 3 slot each.

      Using Flink 1.4, when we rescale a data stream from 60 to 20, each TaskManager will only have one downstream slot, that receives the data from 3 upstream slots in the same TaskManager.

      Using Flink 1.7, this behaviour no longer hold true, multiple downstream slots are being assigned to the same TaskManager. This change is causing imbalance in our TaskManager load.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                kien_truong Truong Duc Kien
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: