Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7069 [Umbrella] YARN Resource Profiles phase#2 enhancements
  3. YARN-7159

Normalize unit of resource objects in RM to avoid unit conversion in critical path

          Details

          • Type: Sub-task
          • Status: Resolved
          • Priority: Critical
          • Resolution: Fixed
          • Affects Version/s: None
          • Fix Version/s: 3.2.0
          • Component/s: nodemanager, resourcemanager
          • Labels:
            None
          • Hadoop Flags:
            Reviewed

            Description

            Currently resource conversion could happen in critical code path when different unit is specified by client. This could impact performance and throughput of RM a lot. We should do unit normalization when resource passed to RM and avoid expensive unit conversion every time.

              Attachments

              1. YARN-7159.001.patch
                14 kB
                Manikandan R
              2. YARN-7159.002.patch
                14 kB
                Manikandan R
              3. YARN-7159.003.patch
                17 kB
                Manikandan R
              4. YARN-7159.004.patch
                18 kB
                Manikandan R
              5. YARN-7159.005.patch
                17 kB
                Manikandan R
              6. YARN-7159.006.patch
                33 kB
                Manikandan R
              7. YARN-7159.007.patch
                35 kB
                Manikandan R
              8. YARN-7159.008.patch
                35 kB
                Manikandan R
              9. YARN-7159.009.patch
                33 kB
                Manikandan R
              10. YARN-7159.010.patch
                35 kB
                Manikandan R
              11. YARN-7159.011.patch
                35 kB
                Manikandan R
              12. YARN-7159.012.patch
                34 kB
                Manikandan R
              13. YARN-7159.013.patch
                35 kB
                Manikandan R
              14. YARN-7159.015.patch
                35 kB
                Manikandan R
              15. YARN-7159.016.patch
                35 kB
                Manikandan R
              16. YARN-7159.017.patch
                35 kB
                Manikandan R
              17. YARN-7159.018.patch
                35 kB
                Manikandan R
              18. YARN-7159.019.patch
                34 kB
                Manikandan R
              19. YARN-7159.020.patch
                35 kB
                Manikandan R
              20. YARN-7159.021.patch
                37 kB
                Manikandan R
              21. YARN-7159.022.patch
                37 kB
                Manikandan R
              22. YARN-7159.023.patch
                32 kB
                Manikandan R

                Issue Links

                relates to

                Bug - A problem which impairs or prevents the functions of the product. YARN-9024 ClusterNodeTracker maximum allocation does not respect resource units

                • Major - Major loss of function.
                • Resolved

                  Activity

                    People

                    • Assignee:
                      manirajv06@gmail.com Manikandan R
                      Reporter:
                      leftnoteasy Wangda Tan
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      7 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: