Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10695 Event related improvement of YARN for better usage.
  3. YARN-9615

Add dispatcher metrics to RM

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0, 3.3.1
    • 3.4.0, 3.3.1
    • metrics, resourcemanager
    • None

    Description

      It'd be good to have counts/processing times for each event type in RM async dispatcher and scheduler async dispatcher.

      Attachments

        1. screenshot-1.png
          41 kB
          Bibin Chundatt
        2. YARN-9615.poc.patch
          18 kB
          Jonathan Hung
        3. YARN-9615.001.patch
          16 kB
          Qi Zhu
        4. YARN-9615.002.patch
          17 kB
          Qi Zhu
        5. YARN-9615.003.patch
          17 kB
          Qi Zhu
        6. YARN-9615.004.patch
          23 kB
          Qi Zhu
        7. YARN-9615.005.patch
          23 kB
          Qi Zhu
        8. YARN-9615.006.patch
          23 kB
          Qi Zhu
        9. YARN-9615.007.patch
          27 kB
          Qi Zhu
        10. image-2021-03-04-10-35-10-626.png
          108 kB
          Qi Zhu
        11. image-2021-03-04-10-36-12-441.png
          356 kB
          Qi Zhu
        12. YARN-9615.008.patch
          27 kB
          Qi Zhu
        13. YARN-9615.009.patch
          27 kB
          Qi Zhu
        14. YARN-9615.010.patch
          31 kB
          Qi Zhu
        15. YARN-9615.011.patch
          31 kB
          Qi Zhu
        16. YARN-9615.011.patch
          31 kB
          Qi Zhu
        17. YARN-9615-branch-3.3-001.patch
          30 kB
          Peter Bacsko

        Issue Links

        Blocked

        Sub-task - The sub-task of the issue YARN-8995 Log events info in AsyncDispatcher when event queue size cumulatively reaches a certain number every time.

        • Major - Major loss of function.
        • Resolved
        causes

        Sub-task - The sub-task of the issue YARN-11247 Remove unused classes introduced by YARN-9615

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved
        duplicates

        Improvement - An improvement or enhancement to an existing feature or task. YARN-262 add event dispatcher metrics

        • Major - Major loss of function.
        • Open

        Improvement - An improvement or enhancement to an existing feature or task. YARN-7229 Add a metric for the size of event queue in AsyncDispatcher

        • Major - Major loss of function.
        • Open
        is duplicated by

        Improvement - An improvement or enhancement to an existing feature or task. YARN-10650 Create dispatcher metrics interface, and apply to RM async dispatcher.

        • Major - Major loss of function.
        • Resolved
        is related to

        Improvement - An improvement or enhancement to an existing feature or task. YARN-10650 Create dispatcher metrics interface, and apply to RM async dispatcher.

        • Major - Major loss of function.
        • Resolved
        relates to

        Sub-task - The sub-task of the issue YARN-9927 RM multi-thread event processing mechanism

        • Major - Major loss of function.
        • Patch Available

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            zhuqi Qi Zhu
            jhung Jonathan Hung
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment