Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8995

Log events info in AsyncDispatcher when event queue size cumulatively reaches a certain number every time.

    XMLWordPrintableJSON

    Details

      Description

      In our growing cluster,there are unexpected situations that cause some event queues to block the performance of the cluster, such as the bug of  https://issues.apache.org/jira/browse/YARN-5262 . I think it's necessary to log the event type of the too big event queue size, and add the information to the metrics, and the threshold of queue size is a parametor which can be changed.

        Attachments

        1. image-2019-09-04-15-20-02-914.png
          8 kB
          zhuqi
        2. TestStreamPerf.java
          3 kB
          Tao Yang
        3. YARN-8995.001.patch
          3 kB
          zhuqi
        4. YARN-8995.002.patch
          4 kB
          zhuqi
        5. YARN-8995.003.patch
          4 kB
          zhuqi
        6. YARN-8995.004.patch
          5 kB
          zhuqi
        7. YARN-8995.005.patch
          8 kB
          zhuqi
        8. YARN-8995.006.patch
          9 kB
          zhuqi
        9. YARN-8995.007.patch
          8 kB
          zhuqi
        10. YARN-8995.008.patch
          9 kB
          zhuqi
        11. YARN-8995.009.patch
          10 kB
          zhuqi
        12. YARN-8995.010.patch
          10 kB
          zhuqi
        13. YARN-8995.011.patch
          9 kB
          zhuqi
        14. YARN-8995.012.patch
          9 kB
          zhuqi
        15. YARN-8995.013.patch
          10 kB
          zhuqi
        16. YARN-8995.014.patch
          10 kB
          zhuqi
        17. YARN-8995.015.patch
          10 kB
          zhuqi
        18. YARN-8995.016.patch
          10 kB
          zhuqi
        19. YARN-8995-branch-3.1.001.patch.addendum
          1 kB
          Jonathan Hung

          Issue Links

            Activity

              People

              • Assignee:
                zhuqi zhuqi
                Reporter:
                zhuqi zhuqi
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: