Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7069 [Umbrella] YARN Resource Profiles phase#2 enhancements
  3. YARN-7159

Normalize unit of resource objects in RM to avoid unit conversion in critical path

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 3.2.0
    • nodemanager, resourcemanager
    • None
    • Reviewed

    Description

      Currently resource conversion could happen in critical code path when different unit is specified by client. This could impact performance and throughput of RM a lot. We should do unit normalization when resource passed to RM and avoid expensive unit conversion every time.

      Attachments

        1. YARN-7159.001.patch
          14 kB
          Manikandan R
        2. YARN-7159.002.patch
          14 kB
          Manikandan R
        3. YARN-7159.003.patch
          17 kB
          Manikandan R
        4. YARN-7159.004.patch
          18 kB
          Manikandan R
        5. YARN-7159.005.patch
          17 kB
          Manikandan R
        6. YARN-7159.006.patch
          33 kB
          Manikandan R
        7. YARN-7159.007.patch
          35 kB
          Manikandan R
        8. YARN-7159.008.patch
          35 kB
          Manikandan R
        9. YARN-7159.009.patch
          33 kB
          Manikandan R
        10. YARN-7159.010.patch
          35 kB
          Manikandan R
        11. YARN-7159.011.patch
          35 kB
          Manikandan R
        12. YARN-7159.012.patch
          34 kB
          Manikandan R
        13. YARN-7159.013.patch
          35 kB
          Manikandan R
        14. YARN-7159.015.patch
          35 kB
          Manikandan R
        15. YARN-7159.016.patch
          35 kB
          Manikandan R
        16. YARN-7159.017.patch
          35 kB
          Manikandan R
        17. YARN-7159.018.patch
          35 kB
          Manikandan R
        18. YARN-7159.019.patch
          34 kB
          Manikandan R
        19. YARN-7159.020.patch
          35 kB
          Manikandan R
        20. YARN-7159.021.patch
          37 kB
          Manikandan R
        21. YARN-7159.022.patch
          37 kB
          Manikandan R
        22. YARN-7159.023.patch
          32 kB
          Manikandan R

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. YARN-9024 ClusterNodeTracker maximum allocation does not respect resource units

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              manirajv06@gmail.com Manikandan R
              leftnoteasy Wangda Tan
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: