Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-4

Refactor metric aggregation with separate collect & aggregate vertex

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Duplicate
    • None
    • None

    Description

      At now, the metric for the data skew handling optimization is collected in each executor and aggregated in the runtime optimization pass.
      It would be good to generalize these metric aggregation process by separating metric collection vertex and metric aggregation vertex.

      Attachments

        Activity

          People

            Unassigned Unassigned
            sanha Sanha Lee
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: