Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4353

Provide short circuit user group mapping for NM/AM

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • 2.7.1
    • None
    • nodemanager
    • None
    • Reviewed

    Description

      When the NM launches an AM, the ContainerLocalizer gets the current user from UserGroupInformation, which triggers user group mapping, even though the user groups are never accessed. If secure LDAP is configured for group mapping, then there are some additional complications created by the unnecessary group resolution. Additionally, it adds unnecessary latency to the container launch time.

      To address the issue, before getting the current user, the ContainerLocalizer should configure UserGroupInformation with a null group mapping service that quickly and quietly returns an empty group list for all users.

      Attachments

        1. YARN-4353.prelim.patch
          2 kB
          Daniel Templeton

        Issue Links

          Activity

            People

              templedf Daniel Templeton
              templedf Daniel Templeton
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: