Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-182

Consider reshaping in run-time optimization

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.2
    • Labels:

      Description

      We need to refactor our run-time optimization to handle reshaping properly.
      At now, optimized plan in run-time just substitute the original plan in BatchScheduler.
      This works fine if the shape of the plan is preserved.
      However, if there is some reshaping phase in optimization, the block and task states have to be updated (and initialized if needed).
      Also, we need to prevent the reshaping and property changing for already executed plan.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              sanha Sanha Lee
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: