Uploaded image for project: 'Apache Twill'
  1. Apache Twill
  2. TWILL-171

Update HDFS delegation token properly for HA mode

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.7.0-incubating
    • Fix Version/s: 0.11.0
    • Component/s: None
    • Labels:
      None
    • Environment:
      HA-enabled NodeManager, Kerberos-enabled

      Description

      There is an issue https://issues.apache.org/jira/browse/HDFS-9276, which can be worked around to update HDFS delegation token properly for HA mode.

      See: https://issues.cask.co/browse/CDAP-5844

        Issue Links

          Activity

          Hide
          anwar1 Ali Anwar added a comment -

          In handling this, we need to make sure that we that we handle different name node services having different schemes.

          Relevant comment:
          https://github.com/caskdata/cdap/pull/5697#discussion_r61483214

          Show
          anwar1 Ali Anwar added a comment - In handling this, we need to make sure that we that we handle different name node services having different schemes. Relevant comment: https://github.com/caskdata/cdap/pull/5697#discussion_r61483214
          Hide
          githubbot ASF GitHub Bot added a comment -

          GitHub user chtyim opened a pull request:

          https://github.com/apache/twill/pull/42

          (TWILL-171) Clone the HDFS delegation in HA mode.

          You can merge this pull request into a Git repository by running:

          $ git pull https://github.com/chtyim/twill feature/TWILL-171

          Alternatively you can review and apply these changes as the patch at:

          https://github.com/apache/twill/pull/42.patch

          To close this pull request, make a commit to your master/trunk branch
          with (at least) the following in the commit message:

          This closes #42


          commit 2813b85f3cfa5ad0e37fd68cf06b1c4d577db76f
          Author: Terence Yim <chtyim@apache.org>
          Date: 2017-03-27T17:51:26Z

          (TWILL-171) Clone the HDFS delegation in HA mode.


          Show
          githubbot ASF GitHub Bot added a comment - GitHub user chtyim opened a pull request: https://github.com/apache/twill/pull/42 ( TWILL-171 ) Clone the HDFS delegation in HA mode. This is for working around HDFS-9276 You can merge this pull request into a Git repository by running: $ git pull https://github.com/chtyim/twill feature/ TWILL-171 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/twill/pull/42.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #42 commit 2813b85f3cfa5ad0e37fd68cf06b1c4d577db76f Author: Terence Yim <chtyim@apache.org> Date: 2017-03-27T17:51:26Z ( TWILL-171 ) Clone the HDFS delegation in HA mode. This is for working around HDFS-9276
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user chtyim commented on the issue:

          https://github.com/apache/twill/pull/42

          @serranom True. We can also try to get it via the `LocationFactory` from the application location, however it won't really make the code easier to understand (there would be unwrapping and `instanceof` check)

          Show
          githubbot ASF GitHub Bot added a comment - Github user chtyim commented on the issue: https://github.com/apache/twill/pull/42 @serranom True. We can also try to get it via the `LocationFactory` from the application location, however it won't really make the code easier to understand (there would be unwrapping and `instanceof` check)
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user anew commented on the issue:

          https://github.com/apache/twill/pull/42

          IMO this is the cleaner, if verbose, way. LGTM +1

          Show
          githubbot ASF GitHub Bot added a comment - Github user anew commented on the issue: https://github.com/apache/twill/pull/42 IMO this is the cleaner, if verbose, way. LGTM +1
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user asfgit closed the pull request at:

          https://github.com/apache/twill/pull/42

          Show
          githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/twill/pull/42

            People

            • Assignee:
              chtyim Terence Yim
              Reporter:
              mynameisalianwar@gmail.com Ali Anwar
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development