Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12563

Updated utility to create/modify token files

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 3.0.0-alpha1
    • None
    • None
    • Incompatible change, Reviewed
    • This feature introduces a new command called "hadoop dtutil" which lets users request and download delegation tokens with certain attributes.

    Description

      hdfs fetchdt is missing some critical features and is geared almost exclusively towards HDFS operations. Additionally, the token files that are created use Java serializations which are hard/impossible to deal with in other languages. It should be replaced with a better utility in common that can read/write protobuf-based token files, has enough flexibility to be used with other services, and offers key functionality such as append and rename. The old version file format should still be supported for backward compatibility, but will be effectively deprecated.

      A follow-on JIRA will deprecrate fetchdt.

      Attachments

        1. HADOOP-12563.01.patch
          52 kB
          Matthew Paduano
        2. HADOOP-12563.02.patch
          52 kB
          Matthew Paduano
        3. HADOOP-12563.03.patch
          53 kB
          Matthew Paduano
        4. generalized_token_case.pdf
          65 kB
          Matthew Paduano
        5. example_dtutil_commands_and_output.txt
          17 kB
          Matthew Paduano
        6. HADOOP-12563.04.patch
          58 kB
          Matthew Paduano
        7. HADOOP-12563.05.patch
          58 kB
          Matthew Paduano
        8. HADOOP-12563.06.patch
          59 kB
          Matthew Paduano
        9. HADOOP-12563.07.patch
          68 kB
          Matthew Paduano
        10. dtutil-test-out
          18 kB
          Matthew Paduano
        11. HADOOP-12563.07.patch
          68 kB
          Allen Wittenauer
        12. HADOOP-12563.08.patch
          69 kB
          Matthew Paduano
        13. HADOOP-12563.09.patch
          74 kB
          Matthew Paduano
        14. HADOOP-12563.10.patch
          81 kB
          Matthew Paduano
        15. HADOOP-12563.11.patch
          81 kB
          Matthew Paduano
        16. HADOOP-12563.12.patch
          82 kB
          Matthew Paduano
        17. HADOOP-12563.13.patch
          82 kB
          Matthew Paduano
        18. HADOOP-12563.14.patch
          82 kB
          Matthew Paduano
        19. HADOOP-12563.15.patch
          95 kB
          Matthew Paduano
        20. HADOOP-12563.16.patch
          95 kB
          Matthew Paduano

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            mattpaduano Matthew Paduano
            aw Allen Wittenauer
            Votes:
            0 Vote for this issue
            Watchers:
            21 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment