Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-102

Stage Partitioning by PhysicalPlanGenerator

    XMLWordPrintableJSON

Details

    Description

      On IR-level, we don't want to expose 'Stage'. Stage partitioning should be delegated to PhysicalPlanGenerator. Following this way, we can avoid ad-hoc properties like 'containerType', 'parallelism', and 'scheduleGroupIndex' in Stage, StageBuilder, and Task.

      Attachments

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. NEMO-73 SchedulingPolicy as Vertex-level Execution Property

          • Major - Major loss of function.
          • Resolved
          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. NEMO-111 Remove enum ExecutionProperty.Key

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #51

          Activity

            People

              jangho JangHo Seo
              jangho JangHo Seo
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: