Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-30213

The edge is wrong when the vertex parallelism is changed

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      After FLINK-29501, flink allows overriding JobVertex parallelisms during job submission.

      However, the edge should be changed as well. For example, the job has 4 vertex, and all shipStrategyName of all tasks are forward.

      After the parallelism of the third task is changed to 1, the second and third edge should be changed from forward to rebalance. But they are still forward.

       

      And from the second picture, the subtask_1 of sink cannot receive any data.

       

      Attachments

        Issue Links

        causes

        Bug - A problem which impairs or prevents the functions of the product. FLINK-33123 Wrong dynamic replacement of partitioner from FORWARD to REBLANCE for autoscaler and adaptive scheduler

        • Critical - Crashes, loss of data, severe memory leak.
        • In Progress
        is caused by

        New Feature - A new feature of the product, which has yet to be developed. FLINK-29501 Allow overriding JobVertex parallelisms during job submission

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved
        links to

        Web Link GitHub Pull Request #21443

        Web Link GitHub Pull Request #21593

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            mxm Maximilian Michels
            fanrui Rui Fan
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment