Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10695 Event related improvement of YARN for better usage.
  3. YARN-10702

Add cluster metric for amount of CPU used by RM Event Processor

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.10.1, 3.4.0
    • Fix Version/s: 3.4.0, 3.3.1, 3.1.5, 3.2.3
    • Component/s: yarn
    • Labels:
      None

      Description

      Add a cluster metric to track the cpu usage of the ResourceManager Event Processing thread. This lets us know when the critical path of the RM is running out of headroom.
      This feature was originally added for us internally by Nathan Roberts and we've been running with it on production clusters for nearly four years.

        Attachments

        1. YARN-10702.001.patch
          14 kB
          Jim Brennan
        2. Scheduler-Busy.png
          33 kB
          Jim Brennan
        3. simon-scheduler-busy.png
          116 kB
          Jim Brennan
        4. YARN-10702.002.patch
          14 kB
          Jim Brennan
        5. YARN-10702.003.patch
          14 kB
          Jim Brennan
        6. YARN-10702.004.patch
          14 kB
          Jim Brennan
        7. YARN-10702.005.patch
          18 kB
          Jim Brennan
        8. YARN-10702.006.patch
          18 kB
          Jim Brennan
        9. YARN-10702-branch-3.3.006.patch
          18 kB
          Jim Brennan
        10. YARN-10702-branch-3.2.006.patch
          18 kB
          Jim Brennan
        11. YARN-10702-branch-3.1.006.patch
          18 kB
          Jim Brennan

          Activity

            People

            • Assignee:
              Jim_Brennan Jim Brennan
              Reporter:
              Jim_Brennan Jim Brennan
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: