Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10695 Event related improvement of YARN for better usage.
  3. YARN-9615

Add dispatcher metrics to RM

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0, 3.3.1
    • 3.4.0, 3.3.1
    • metrics, resourcemanager
    • None

    Description

      It'd be good to have counts/processing times for each event type in RM async dispatcher and scheduler async dispatcher.

      Attachments

        1. screenshot-1.png
          41 kB
          Bibin Chundatt
        2. YARN-9615.poc.patch
          18 kB
          Jonathan Hung
        3. YARN-9615.001.patch
          16 kB
          Qi Zhu
        4. YARN-9615.002.patch
          17 kB
          Qi Zhu
        5. YARN-9615.003.patch
          17 kB
          Qi Zhu
        6. YARN-9615.004.patch
          23 kB
          Qi Zhu
        7. YARN-9615.005.patch
          23 kB
          Qi Zhu
        8. YARN-9615.006.patch
          23 kB
          Qi Zhu
        9. YARN-9615.007.patch
          27 kB
          Qi Zhu
        10. image-2021-03-04-10-35-10-626.png
          108 kB
          Qi Zhu
        11. image-2021-03-04-10-36-12-441.png
          356 kB
          Qi Zhu
        12. YARN-9615.008.patch
          27 kB
          Qi Zhu
        13. YARN-9615.009.patch
          27 kB
          Qi Zhu
        14. YARN-9615.010.patch
          31 kB
          Qi Zhu
        15. YARN-9615.011.patch
          31 kB
          Qi Zhu
        16. YARN-9615.011.patch
          31 kB
          Qi Zhu
        17. YARN-9615-branch-3.3-001.patch
          30 kB
          Peter Bacsko

        Issue Links

          Blocked

          Sub-task - The sub-task of the issue YARN-8995 Log events info in AsyncDispatcher when event queue size cumulatively reaches a certain number every time.

          • Major - Major loss of function.
          • Resolved
          causes

          Sub-task - The sub-task of the issue YARN-11247 Remove unused classes introduced by YARN-9615

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. YARN-262 add event dispatcher metrics

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. YARN-7229 Add a metric for the size of event queue in AsyncDispatcher

          • Major - Major loss of function.
          • Open
          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. YARN-10650 Create dispatcher metrics interface, and apply to RM async dispatcher.

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. YARN-10650 Create dispatcher metrics interface, and apply to RM async dispatcher.

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue YARN-9927 RM multi-thread event processing mechanism

          • Major - Major loss of function.
          • Patch Available

          Activity

            People

              zhuqi Qi Zhu
              jhung Jonathan Hung
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: