Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10695 Event related improvement of YARN for better usage.
  3. YARN-8995

Log events info in AsyncDispatcher when event queue size cumulatively reaches a certain number every time.

    XMLWordPrintableJSON

    Details

      Description

      In our growing cluster,there are unexpected situations that cause some event queues to block the performance of the cluster, such as the bug of  https://issues.apache.org/jira/browse/YARN-5262 . I think it's necessary to log the event type of the too big event queue size, and add the information to the metrics, and the threshold of queue size is a parametor which can be changed.

        Attachments

        1. YARN-8995-branch-3.1.001.patch.addendum
          1 kB
          Jonathan Hung
        2. YARN-8995.016.patch
          10 kB
          Qi Zhu
        3. YARN-8995.015.patch
          10 kB
          Qi Zhu
        4. image-2019-09-04-15-20-02-914.png
          8 kB
          Qi Zhu
        5. YARN-8995.014.patch
          10 kB
          Qi Zhu
        6. YARN-8995.013.patch
          10 kB
          Qi Zhu
        7. YARN-8995.012.patch
          9 kB
          Qi Zhu
        8. YARN-8995.011.patch
          9 kB
          Qi Zhu
        9. YARN-8995.010.patch
          10 kB
          Qi Zhu
        10. YARN-8995.009.patch
          10 kB
          Qi Zhu
        11. YARN-8995.008.patch
          9 kB
          Qi Zhu
        12. YARN-8995.007.patch
          8 kB
          Qi Zhu
        13. YARN-8995.006.patch
          9 kB
          Qi Zhu
        14. YARN-8995.005.patch
          8 kB
          Qi Zhu
        15. YARN-8995.004.patch
          5 kB
          Qi Zhu
        16. TestStreamPerf.java
          3 kB
          Tao Yang
        17. YARN-8995.003.patch
          4 kB
          Qi Zhu
        18. YARN-8995.002.patch
          4 kB
          Qi Zhu
        19. YARN-8995.001.patch
          3 kB
          Qi Zhu

          Issue Links

            Activity

              People

              • Assignee:
                zhuqi Qi Zhu
                Reporter:
                zhuqi Qi Zhu
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: