Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5322

HDFS delegation token not found in cache errors seen on secure HA clusters

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.1.1-beta
    • 2.3.0
    • ha
    • None
    • Reviewed

    Description

      While running HA tests we have seen issues were we see HDFS delegation token not found in cache errors causing jobs running to fail.

      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
      at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:157)
      |2013-10-06 20:14:51,193 INFO  [main] mapreduce.Job: Task Id : attempt_1381090351344_0001_m_000007_0, Status : FAILED
      Error: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken): token (HDFS_DELEGATION_TOKEN token 11 for hrt_qa) can't be found in cache
      at org.apache.hadoop.ipc.Client.call(Client.java:1347)
      at org.apache.hadoop.ipc.Client.call(Client.java:1300)
      at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
      at com.sun.proxy.$Proxy10.getBlockLocations(Unknown Source)
      

      Attachments

        1. HDFS-5322.000.patch
          10 kB
          Jing Zhao
        2. HDFS-5322.000.patch
          10 kB
          Jing Zhao
        3. HDFS-5322.001.patch
          11 kB
          Jing Zhao
        4. HDFS-5322.002.patch
          13 kB
          Jing Zhao
        5. HDFS-5322.003.patch
          20 kB
          Jing Zhao
        6. HDFS-5322.004.patch
          17 kB
          Jing Zhao
        7. HDFS-5322.005.patch
          17 kB
          Jing Zhao
        8. HDFS-5322.006.patch
          20 kB
          Jing Zhao

        Issue Links

          Activity

            People

              jingzhao Jing Zhao
              arpitgupta Arpit Gupta
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: