Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-321

Fix the data skew pass metric mismatch

    XMLWordPrintableJSON

Details

    Description

      DataSkewPolicy has a mismatch in calculating data size metric.

      The metric calculation and aggregation vertex count the occurrence of each actual key (Object), but the runtime pass assumes that the keys of collected metric represent the partition key (integer).

      We need to resolve this mismatch.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              sanha Sanha Lee
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h