Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-181

Fix DataSkewPolicy bug for multiple shuffles

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.1

    Description

      DataSkewPolicy should be able to handle job DAG with multiple shuffles. For this, we need to modify DataSkewRuntimePass so that the target optimization edge can be identified via ExecutionProperty.

      Attachments

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. NEMO-64 Fix map stage hang under DataSkewPolicy

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              jeongyoon Jeongyoon Eo
              jeongyoon Jeongyoon Eo
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: