Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5322

HDFS delegation token not found in cache errors seen on secure HA clusters

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.1.1-beta
    • Fix Version/s: 2.3.0
    • Component/s: ha
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      While running HA tests we have seen issues were we see HDFS delegation token not found in cache errors causing jobs running to fail.

      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
      at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:157)
      |2013-10-06 20:14:51,193 INFO  [main] mapreduce.Job: Task Id : attempt_1381090351344_0001_m_000007_0, Status : FAILED
      Error: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken): token (HDFS_DELEGATION_TOKEN token 11 for hrt_qa) can't be found in cache
      at org.apache.hadoop.ipc.Client.call(Client.java:1347)
      at org.apache.hadoop.ipc.Client.call(Client.java:1300)
      at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
      at com.sun.proxy.$Proxy10.getBlockLocations(Unknown Source)
      

        Attachments

        1. HDFS-5322.000.patch
          10 kB
          Jing Zhao
        2. HDFS-5322.000.patch
          10 kB
          Jing Zhao
        3. HDFS-5322.001.patch
          11 kB
          Jing Zhao
        4. HDFS-5322.002.patch
          13 kB
          Jing Zhao
        5. HDFS-5322.003.patch
          20 kB
          Jing Zhao
        6. HDFS-5322.004.patch
          17 kB
          Jing Zhao
        7. HDFS-5322.005.patch
          17 kB
          Jing Zhao
        8. HDFS-5322.006.patch
          20 kB
          Jing Zhao

          Issue Links

            Activity

              People

              • Assignee:
                jingzhao Jing Zhao
                Reporter:
                arpitgupta Arpit Gupta
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: