Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-182

Consider reshaping in run-time optimization

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 0.2

    Description

      We need to refactor our run-time optimization to handle reshaping properly.
      At now, optimized plan in run-time just substitute the original plan in BatchScheduler.
      This works fine if the shape of the plan is preserved.
      However, if there is some reshaping phase in optimization, the block and task states have to be updated (and initialized if needed).
      Also, we need to prevent the reshaping and property changing for already executed plan.

      Attachments

        Activity

          People

            Unassigned Unassigned
            sanha Sanha Lee
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: