Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8995

Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.2.0, 3.3.0
    • Fix Version/s: None
    • Labels:
      None

      Description

      In our growing cluster,there are unexpected situations that cause some event queues to block the performance of the cluster, such as the bug of  https://issues.apache.org/jira/browse/YARN-5262 . I think it's necessary to log the event type of the too big event queue size, and add the information to the metrics, and the threshold of queue size is a parametor which can be changed.

        Attachments

        1. TestStreamPerf.java
          3 kB
          Tao Yang
        2. YARN-8995.001.patch
          3 kB
          zhuqi
        3. YARN-8995.002.patch
          4 kB
          zhuqi
        4. YARN-8995.003.patch
          4 kB
          zhuqi
        5. YARN-8995.004.patch
          5 kB
          zhuqi
        6. YARN-8995.005.patch
          8 kB
          zhuqi
        7. YARN-8995.006.patch
          9 kB
          zhuqi
        8. YARN-8995.007.patch
          8 kB
          zhuqi
        9. YARN-8995.008.patch
          9 kB
          zhuqi

          Issue Links

            Activity

              People

              • Assignee:
                zhuqi zhuqi
                Reporter:
                zhuqi zhuqi
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated: