Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10695 Event related improvement of YARN for better usage.
  3. YARN-8995

Log events info in AsyncDispatcher when event queue size cumulatively reaches a certain number every time.

    XMLWordPrintableJSON

Details

    Description

      In our growing cluster,there are unexpected situations that cause some event queues to block the performance of the cluster, such as the bug of  https://issues.apache.org/jira/browse/YARN-5262 . I think it's necessary to log the event type of the too big event queue size, and add the information to the metrics, and the threshold of queue size is a parametor which can be changed.

      Attachments

        1. YARN-8995.001.patch
          3 kB
          Qi Zhu
        2. YARN-8995.002.patch
          4 kB
          Qi Zhu
        3. YARN-8995.003.patch
          4 kB
          Qi Zhu
        4. TestStreamPerf.java
          3 kB
          Tao Yang
        5. YARN-8995.004.patch
          5 kB
          Qi Zhu
        6. YARN-8995.005.patch
          8 kB
          Qi Zhu
        7. YARN-8995.006.patch
          9 kB
          Qi Zhu
        8. YARN-8995.007.patch
          8 kB
          Qi Zhu
        9. YARN-8995.008.patch
          9 kB
          Qi Zhu
        10. YARN-8995.009.patch
          10 kB
          Qi Zhu
        11. YARN-8995.010.patch
          10 kB
          Qi Zhu
        12. YARN-8995.011.patch
          9 kB
          Qi Zhu
        13. YARN-8995.012.patch
          9 kB
          Qi Zhu
        14. YARN-8995.013.patch
          10 kB
          Qi Zhu
        15. YARN-8995.014.patch
          10 kB
          Qi Zhu
        16. image-2019-09-04-15-20-02-914.png
          8 kB
          Qi Zhu
        17. YARN-8995.015.patch
          10 kB
          Qi Zhu
        18. YARN-8995.016.patch
          10 kB
          Qi Zhu
        19. YARN-8995-branch-3.1.001.patch.addendum
          1 kB
          Jonathan Hung

        Issue Links

          Activity

            People

              zhuqi Qi Zhu
              zhuqi Qi Zhu
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: