Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6242 [Umbrella] Miscellaneous Scheduler Performance Improvements
  3. YARN-6679

Reduce Resource instance overhead via non-PBImpl

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.8.0
    • 2.9.0, 3.0.0-alpha4
    • resourcemanager
    • None
    • Reviewed

    Description

      Creating and using transient PB-based Resource instances during scheduling is very expensive. The overhead can be transparently reduced by internally using lightweight non-PB based instances.

      Attachments

        1. YARN-6679.2.branch-2.patch
          39 kB
          Daryn Sharp
        2. YARN-6679.2.trunk.patch
          36 kB
          Daryn Sharp
        3. YARN-6679.3.branch-2.patch
          40 kB
          Daryn Sharp
        4. YARN-6679.3.trunk.patch
          37 kB
          Daryn Sharp
        5. YARN-6679.branch-2.patch
          37 kB
          Daryn Sharp
        6. YARN-6679.trunk.patch
          34 kB
          Daryn Sharp

        Activity

          People

            daryn Daryn Sharp
            daryn Daryn Sharp
            Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: