Details

    • Type: Sub-task
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.6.0, 2.7.0, 2.8.0, 2.9.0, 3.0.0, 3.1.0
    • Fix Version/s: None
    • Component/s: RM, scheduler
    • Labels:
      None

      Description

      In some scenarios, applications will request nonexistent resource name in this cluster, such as nonexistent hosts or racks.

      Obviously, we should filter or degrade these invaild resource requests actively.

      This is especially effective when HDFS and Yarn are deployed on different nodes, and the scheduling throughput of one of our clusters has improved by 5X.

        Attachments

        1. YARN-9276.001.patch
          8 kB
          Zhaohui Xin
        2. Cluster-Scheduler-Performance-5X-Promotion.png
          193 kB
          Zhaohui Xin

          Issue Links

            Activity

              People

              • Assignee:
                uranus Zhaohui Xin
                Reporter:
                uranus Zhaohui Xin
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: