Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-321

Fix the data skew pass metric mismatch

    XMLWordPrintableJSON

    Details

      Description

      DataSkewPolicy has a mismatch in calculating data size metric.

      The metric calculation and aggregation vertex count the occurrence of each actual key (Object), but the runtime pass assumes that the keys of collected metric represent the partition key (integer).

      We need to resolve this mismatch.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                sanha Sanha Lee
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h