Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4805

Webhdfs client is fragile to token renewal errors

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.0, 2.0.0-alpha, 3.0.0-alpha1
    • Fix Version/s: 2.1.0-beta
    • Component/s: webhdfs
    • Labels:
      None

      Description

      Webhdfs internally acquires a token that will be used for DN-based operations. The token renewer in common will try to renew that token. If a renewal fails for any reason, it will try to get another token. If that fails, it gives up and the token webhdfs holds will soon expire.

      A transient network outage or a restart of the NN may cause webhdfs to be left holding an expired token, effectively rendering webhdfs useless. This is fatal for daemons.

        Attachments

        1. HDFS-4805.patch
          6 kB
          Daryn Sharp

          Activity

            People

            • Assignee:
              daryn Daryn Sharp
              Reporter:
              daryn Daryn Sharp
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: