Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6510

WebHdfs clients clears the delegation token on retry (for HA), thus failing retry requests

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 2.4.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      In WebHdfs clients connected to a HA HDFS service, when a failure (that is inferred as a failover) happens and retry is attempted, the delegation token previously initialized is cleared. For token based auth, this causes all the subsequent retries to fail due to auth errors.
      See "delegationToken = null" in method WebHdfsFileSystem.resetStateToFailOver.
      This issue would not only show up on failover, but happens more commonly when the first NN specified in the config is not reachable.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                yzhangal Yongjun Zhang
                Reporter:
                yzhangal Yongjun Zhang
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: