Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7619

Max AM Resource value in Capacity Scheduler UI has to be refreshed for every user

    Details

    • Hadoop Flags:
      Reviewed

      Description

      YARN-7245 addressed the problem that the Max AM Resource in the capacity scheduler UI used to contain the queue-level AM limit instead of the user-level AM limit. It fixed this by using the user-specific AM limit that is calculated in LeafQueue#activateApplications, stored in each user's LeafQueue#User object, and retrieved via UserInfo#getResourceUsageInfo.

      The problem is that this user-specific AM limit depends on the activity of other users and other applications in a queue, and it is only calculated and updated when a user's application is activated. So, when CapacitySchedulerPage retrieves the user-specific AM limit, it is a stale value unless an application was recently activated for a particular user.

        Attachments

        1. YARN-7619.005.branch-2.8.patch
          14 kB
          Eric Payne
        2. YARN-7619.005.branch-3.0.patch
          13 kB
          Eric Payne
        3. YARN-7619.005.patch
          14 kB
          Eric Payne
        4. YARN-7619.004.branch-2.8.patch
          14 kB
          Eric Payne
        5. YARN-7619.004.branch-3.0.patch
          13 kB
          Eric Payne
        6. YARN-7619.004.patch
          14 kB
          Eric Payne
        7. YARN-7619.003.patch
          14 kB
          Eric Payne
        8. YARN-7619.002.patch
          12 kB
          Eric Payne
        9. YARN-7619.001.patch
          12 kB
          Eric Payne
        10. Max AM Resources is Different for Each User.png
          275 kB
          Eric Payne

          Issue Links

            Activity

              People

              • Assignee:
                eepayne Eric Payne
                Reporter:
                eepayne Eric Payne
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: