Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-5473

setMaxParallelism() higher than 1 is possible on non-parallel operators

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.2.0
    • Fix Version/s: 1.2.0, 1.3.0
    • Component/s: DataStream API
    • Labels:
      None

      Description

      While trying out Flink 1.2, I found out that you can set a maxParallelism higher than 1 on a non-parallel operator.
      I think we should have the same semantics as the setParallelism() method.

      Also, when setting a global maxParallelism in the execution environment, it will be set as a default value for the non-parallel operator.
      When restoring a savepoint from 1.1, you have to set the maxParallelism to the parallelism of the 1.1 job. Non-parallel operators will then also get the maxPar set to this value, leading to an error on restore.

      So currently, users restoring from 1.1 to 1.2 have to manually set the maxParallelism to 1 for all non-parallel operators.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                srichter Stefan Richter
                Reporter:
                rmetzger Robert Metzger
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: