Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-32589

Carry over parallelism overrides to prevent users from clearing them on updates

    XMLWordPrintableJSON

Details

    Description

      The autoscaler currently sets the parallelism overrides via the Flink config pipeline.jobvertex-parallelism-overrides. Whenever the user posts specs updates, special care needs to be taken in order to carry over existing overrides. Otherwise the job will reset to the default parallelism configuration. Users shouldn't have to deal with this. Instead, whenever a new spec is posted which does not contain the overrides, the operator should automatically apply the last-used overrides (if autoscaling is enabled).

      Attachments

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. FLINK-32774 Reconciliation for autoscaling overrides gets stuck after cancel-with-savepoint

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          links to

          Web Link GitHub Pull Request #633

          Activity

            People

              gyfora Gyula Fora
              mxm Maximilian Michels
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: