Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3932

SchedulerApplicationAttempt#getResourceUsageReport and UserInfo should based on total-used-resources

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: resourcemanager
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Application Resource Report shown wrong when node Label is used.

      1.Submit application with NodeLabel
      2.Check RM UI for resources used
      Allocated CPU VCores and Allocated Memory MB is always zero

       public synchronized ApplicationResourceUsageReport getResourceUsageReport() {
          AggregateAppResourceUsage runningResourceUsage =
              getRunningAggregateAppResourceUsage();
          Resource usedResourceClone =
              Resources.clone(attemptResourceUsage.getUsed());
          Resource reservedResourceClone =
              Resources.clone(attemptResourceUsage.getReserved());
          return ApplicationResourceUsageReport.newInstance(liveContainers.size(),
              reservedContainers.size(), usedResourceClone, reservedResourceClone,
              Resources.add(usedResourceClone, reservedResourceClone),
              runningResourceUsage.getMemorySeconds(),
              runningResourceUsage.getVcoreSeconds());
        }
      

      should be attemptResourceUsage.getUsed(label)

        Attachments

        1. 0001-YARN-3932.patch
          1 kB
          Bibin A Chundatt
        2. 0002-YARN-3932.patch
          5 kB
          Bibin A Chundatt
        3. 0003-YARN-3932.patch
          6 kB
          Bibin A Chundatt
        4. 0004-YARN-3932.patch
          7 kB
          Bibin A Chundatt
        5. 0005-YARN-3932.patch
          7 kB
          Bibin A Chundatt
        6. 0006-YARN-3932.patch
          7 kB
          Bibin A Chundatt
        7. ApplicationReport.jpg
          12 kB
          Bibin A Chundatt
        8. TestResult.jpg
          9 kB
          Bibin A Chundatt

          Issue Links

            Activity

              People

              • Assignee:
                bibinchundatt Bibin A Chundatt
                Reporter:
                bibinchundatt Bibin A Chundatt
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: