Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4805

Webhdfs client is fragile to token renewal errors

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.23.0, 2.0.0-alpha, 3.0.0-alpha1
    • 2.1.0-beta
    • webhdfs
    • None

    Description

      Webhdfs internally acquires a token that will be used for DN-based operations. The token renewer in common will try to renew that token. If a renewal fails for any reason, it will try to get another token. If that fails, it gives up and the token webhdfs holds will soon expire.

      A transient network outage or a restart of the NN may cause webhdfs to be left holding an expired token, effectively rendering webhdfs useless. This is fatal for daemons.

      Attachments

        1. HDFS-4805.patch
          6 kB
          Daryn Sharp

        Activity

          People

            daryn Daryn Sharp
            daryn Daryn Sharp
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: