Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3216

Support for more precise partition stats in VertexManagerEvent

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.9.0
    • None
    • None

    Description

      Follow up on TEZ-3206 discussion, at least for some use cases, more accurate partition stats will be useful for DataMovementEvent routing. Maybe we can provide a config option to allow apps to choose the more accurate partition stats over RoaringBitmap.

      Attachments

        1. TEZ-3216-4.patch
          45 kB
          Ming Ma
        2. TEZ-3216-3.patch
          45 kB
          Ming Ma
        3. TEZ-3216-2.patch
          45 kB
          Ming Ma
        4. TEZ-3216.patch
          36 kB
          Ming Ma

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. TEZ-3209 Support for fair custom data routing

          • Major - Major loss of function.
          • Open
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. TEZ-3303 Have ShuffleVertexManager consume more precise partition stats

          • Major - Major loss of function.
          • Closed

          Activity

            People

              mingma Ming Ma
              mingma Ming Ma
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: