Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7069 [Umbrella] YARN Resource Profiles phase#2 enhancements
  3. YARN-7159

Normalize unit of resource objects in RM to avoid unit conversion in critical path

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.2.0
    • Component/s: nodemanager, resourcemanager
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently resource conversion could happen in critical code path when different unit is specified by client. This could impact performance and throughput of RM a lot. We should do unit normalization when resource passed to RM and avoid expensive unit conversion every time.

        Attachments

        1. YARN-7159.001.patch
          14 kB
          Manikandan R
        2. YARN-7159.002.patch
          14 kB
          Manikandan R
        3. YARN-7159.003.patch
          17 kB
          Manikandan R
        4. YARN-7159.004.patch
          18 kB
          Manikandan R
        5. YARN-7159.005.patch
          17 kB
          Manikandan R
        6. YARN-7159.006.patch
          33 kB
          Manikandan R
        7. YARN-7159.007.patch
          35 kB
          Manikandan R
        8. YARN-7159.008.patch
          35 kB
          Manikandan R
        9. YARN-7159.009.patch
          33 kB
          Manikandan R
        10. YARN-7159.010.patch
          35 kB
          Manikandan R
        11. YARN-7159.011.patch
          35 kB
          Manikandan R
        12. YARN-7159.012.patch
          34 kB
          Manikandan R
        13. YARN-7159.013.patch
          35 kB
          Manikandan R
        14. YARN-7159.015.patch
          35 kB
          Manikandan R
        15. YARN-7159.016.patch
          35 kB
          Manikandan R
        16. YARN-7159.017.patch
          35 kB
          Manikandan R
        17. YARN-7159.018.patch
          35 kB
          Manikandan R
        18. YARN-7159.019.patch
          34 kB
          Manikandan R
        19. YARN-7159.020.patch
          35 kB
          Manikandan R
        20. YARN-7159.021.patch
          37 kB
          Manikandan R
        21. YARN-7159.022.patch
          37 kB
          Manikandan R
        22. YARN-7159.023.patch
          32 kB
          Manikandan R

          Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. YARN-9024 ClusterNodeTracker maximum allocation does not respect resource units

          • Major - Major loss of function.
          • Resolved

            Activity

              People

              • Assignee:
                manirajv06@gmail.com Manikandan R
                Reporter:
                leftnoteasy Wangda Tan
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: