Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1321

NMTokenCache is a singleton, prevents multiple AMs running in a single JVM to work correctly

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.2.0
    • Fix Version/s: 2.3.0
    • Component/s: client
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      NMTokenCache is a singleton. Because of this, if running multiple AMs in a single JVM NMTokens for the same node from different AMs step on each other and starting containers fail due to mismatch tokens.

      The error observed in the client side is something like:

      ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:llama (auth:PROXY) via llama (auth:SIMPLE) cause:org.apache.hadoop.yarn.exceptions.YarnException: Unauthorized request to start container. 
      NMToken for application attempt : appattempt_1382038445650_0002_000001 was used for starting container with container token issued for application attempt : appattempt_1382038445650_0001_000001
      

        Attachments

        1. YARN-1321.patch
          19 kB
          Alejandro Abdelnur
        2. YARN-1321-20131029.txt
          19 kB
          Vinod Kumar Vavilapalli
        3. YARN-1321.patch
          18 kB
          Alejandro Abdelnur
        4. YARN-1321.patch
          20 kB
          Alejandro Abdelnur
        5. YARN-1321.patch
          19 kB
          Alejandro Abdelnur
        6. YARN-1321.patch
          19 kB
          Alejandro Abdelnur
        7. YARN-1321.patch
          32 kB
          Alejandro Abdelnur

          Activity

            People

            • Assignee:
              tucu00 Alejandro Abdelnur
              Reporter:
              tucu00 Alejandro Abdelnur
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: