Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7619

Max AM Resource value in Capacity Scheduler UI has to be refreshed for every user

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      YARN-7245 addressed the problem that the Max AM Resource in the capacity scheduler UI used to contain the queue-level AM limit instead of the user-level AM limit. It fixed this by using the user-specific AM limit that is calculated in LeafQueue#activateApplications, stored in each user's LeafQueue#User object, and retrieved via UserInfo#getResourceUsageInfo.

      The problem is that this user-specific AM limit depends on the activity of other users and other applications in a queue, and it is only calculated and updated when a user's application is activated. So, when CapacitySchedulerPage retrieves the user-specific AM limit, it is a stale value unless an application was recently activated for a particular user.

      Attachments

        1. YARN-7619.005.patch
          14 kB
          Eric Payne
        2. YARN-7619.005.branch-3.0.patch
          13 kB
          Eric Payne
        3. YARN-7619.005.branch-2.8.patch
          14 kB
          Eric Payne
        4. YARN-7619.004.patch
          14 kB
          Eric Payne
        5. YARN-7619.004.branch-3.0.patch
          13 kB
          Eric Payne
        6. YARN-7619.004.branch-2.8.patch
          14 kB
          Eric Payne
        7. YARN-7619.003.patch
          14 kB
          Eric Payne
        8. YARN-7619.002.patch
          12 kB
          Eric Payne
        9. YARN-7619.001.patch
          12 kB
          Eric Payne
        10. Max AM Resources is Different for Each User.png
          275 kB
          Eric Payne

        Issue Links

          Activity

            People

              epayne Eric Payne
              epayne Eric Payne
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: