Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6418

Reduce Resource object creation and overhead in Capacity scheduler inner loop

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 2.7.3, 3.0.0-alpha2
    • None
    • None

    Description

      Resource object is used multiple due to ResourceCalculator creates new instances on every method call. This gets called several times on each node HB. Resource is a very expensive object that relies on Protobufs

      The change is to remove the need to use protobuf on the Resource object and avoid creating many objects in the Resource Calculator all the time

      Attachments

        Activity

          People

            roniburd Roni Burd
            roniburd Roni Burd
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: