XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-alpha4
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      As per the current implementation for AM blacklisting, disabling is based on complete cluster resource.
      Incase of partitioned cluster though, nodes applicable for AM labels only should be considered as total nodes.

      Additionally for unmanaged AM as AM blacklisting is not done as AM is not launched by RM, it is equivalent to AM blacklisting being disabled for this app. Hence we do not need to create a SimpleBlacklistManager object in RMAppImpl#createNewAttempt.
      We can create DisabledBlacklistManager object instead.

          BlacklistManager currentAMBlacklist;
          if (currentAttempt != null) {
            currentAMBlacklist = currentAttempt.getAMBlacklist();
          } else {
            if (amBlacklistingEnabled) {
              currentAMBlacklist = new SimpleBlacklistManager(
                  scheduler.getNumClusterNodes(), blacklistDisableThreshold);
            } else {
              currentAMBlacklist = new DisabledBlacklistManager();
            }
          }
      

        Attachments

        1. YARN-6156.0001.patch
          7 kB
          Bibin Chundatt
        2. YARN-6156.0002.patch
          13 kB
          Bibin Chundatt
        3. YARN-6156.0003.patch
          13 kB
          Bibin Chundatt
        4. YARN-6156.0004.patch
          13 kB
          Bibin Chundatt
        5. YARN-6156.0005.patch
          13 kB
          Bibin Chundatt
        6. YARN-6156.0006.patch
          13 kB
          Bibin Chundatt

          Issue Links

            Activity

              People

              • Assignee:
                bibinchundatt Bibin Chundatt
                Reporter:
                bibinchundatt Bibin Chundatt
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: