Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4047

ClientRMService getApplications has high scheduler lock contention

    Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      The getApplications call can be particuarly expensive because the code can call checkAccess on every application being tracked by the RM. checkAccess will often call scheduler.checkAccess which will grab the big scheduler lock. This can cause a lot of contention with the scheduler thread which is busy trying to process node heartbeats, app allocation requests, etc.

        Attachments

          Activity

            People

            • Assignee:
              jlowe Jason Lowe
              Reporter:
              jlowe Jason Lowe
            • Votes:
              1 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: