Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-181

Fix DataSkewPolicy bug for multiple shuffles

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.1
    • Labels:

      Description

      DataSkewPolicy should be able to handle job DAG with multiple shuffles. For this, we need to modify DataSkewRuntimePass so that the target optimization edge can be identified via ExecutionProperty.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jeongyoon Jeongyoon Eo
                Reporter:
                jeongyoon Jeongyoon Eo
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: