Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-3255

Chaining behavior should not depend on parallelism

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.10.1
    • 1.0.0
    • None
    • None

    Description

      Currently, operators are chained more aggressively when the parallelism is one. That makes debugging tougher as it changes threading behavior.

      The benefits are also limited: Real installations where that type of efficiency would be needed would not run in parallelism 1, or would not use a partitioning/broadcast step there (if explicitly required to run parallelism 1).

      In the future, when we want to allow parallelism to be adjusted dynamically, this will be even more tricky.

      Attachments

        Activity

          People

            sewen Stephan Ewen
            sewen Stephan Ewen
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: