Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-2589

unnecessary hftp token fetch and renewal thread

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1.0.0
    • Component/s: security
    • Labels:
      None
    • Target Version/s:

      Description

      Instantiation of the hftp filesystem is causing a token to be implicitly created and added to a custom token renewal thread. With the new token renewal feature in the JT, this causes the mapreduce obtainTokensForNamenodes to fetch two tokens (an implicit and uncancelled token, and an explicit token) and leave a spurious renewal thread running. This thread should not be running in the JT.

      After speaking with Owen, the quick solution is to lazy fetch the token, and to lazy start the renewer thread.

        Issue Links

          Activity

          Daryn Sharp created issue -
          Daryn Sharp made changes -
          Field Original Value New Value
          Attachment HDFS-2589.patch [ 12504914 ]
          Daryn Sharp made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Matt Foley made changes -
          Target Version/s 1.0.0 [ 12318243 ] 1.1.0 [ 12317959 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue duplicates HDFS-1389 [ HDFS-1389 ]
          Matt Foley made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Target Version/s 1.1.0 [ 12317959 ] 1.0.0 [ 12318243 ]
          Fix Version/s 1.0.0 [ 12318243 ]
          Resolution Fixed [ 1 ]
          Matt Foley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Daryn Sharp
              Reporter:
              Daryn Sharp
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development