Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-30213

The edge is wrong when the vertex parallelism is changed

    XMLWordPrintableJSON

Details

    Description

      After FLINK-29501, flink allows overriding JobVertex parallelisms during job submission.

      However, the edge should be changed as well. For example, the job has 4 vertex, and all shipStrategyName of all tasks are forward.

      After the parallelism of the third task is changed to 1, the second and third edge should be changed from forward to rebalance. But they are still forward.

       

      And from the second picture, the subtask_1 of sink cannot receive any data.

       

      Attachments

        1. image-2022-11-25-17-02-12-492.png
          55 kB
          Rui Fan
        2. image-2022-11-25-17-06-53-466.png
          124 kB
          Rui Fan
        3. image-2022-11-25-21-58-48-968.png
          143 kB
          Gyula Fora

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. FLINK-33123 Wrong dynamic replacement of partitioner from FORWARD to REBLANCE for autoscaler and adaptive scheduler

          • Critical - Crashes, loss of data, severe memory leak.
          • In Progress
          is caused by

          New Feature - A new feature of the product, which has yet to be developed. FLINK-29501 Allow overriding JobVertex parallelisms during job submission

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Web Link GitHub Pull Request #21443

          Web Link GitHub Pull Request #21593

          Activity

            People

              mxm Maximilian Michels
              fanrui Rui Fan
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: