Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12563

Updated utility to create/modify token files

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 3.0.0-alpha1
    • None
    • None
    • Incompatible change, Reviewed
    • This feature introduces a new command called "hadoop dtutil" which lets users request and download delegation tokens with certain attributes.

    Description

      hdfs fetchdt is missing some critical features and is geared almost exclusively towards HDFS operations. Additionally, the token files that are created use Java serializations which are hard/impossible to deal with in other languages. It should be replaced with a better utility in common that can read/write protobuf-based token files, has enough flexibility to be used with other services, and offers key functionality such as append and rename. The old version file format should still be supported for backward compatibility, but will be effectively deprecated.

      A follow-on JIRA will deprecrate fetchdt.

      Attachments

        1. dtutil-test-out
          18 kB
          Matthew Paduano
        2. example_dtutil_commands_and_output.txt
          17 kB
          Matthew Paduano
        3. generalized_token_case.pdf
          65 kB
          Matthew Paduano
        4. HADOOP-12563.01.patch
          52 kB
          Matthew Paduano
        5. HADOOP-12563.02.patch
          52 kB
          Matthew Paduano
        6. HADOOP-12563.03.patch
          53 kB
          Matthew Paduano
        7. HADOOP-12563.04.patch
          58 kB
          Matthew Paduano
        8. HADOOP-12563.05.patch
          58 kB
          Matthew Paduano
        9. HADOOP-12563.06.patch
          59 kB
          Matthew Paduano
        10. HADOOP-12563.07.patch
          68 kB
          Allen Wittenauer
        11. HADOOP-12563.07.patch
          68 kB
          Matthew Paduano
        12. HADOOP-12563.08.patch
          69 kB
          Matthew Paduano
        13. HADOOP-12563.09.patch
          74 kB
          Matthew Paduano
        14. HADOOP-12563.10.patch
          81 kB
          Matthew Paduano
        15. HADOOP-12563.11.patch
          81 kB
          Matthew Paduano
        16. HADOOP-12563.12.patch
          82 kB
          Matthew Paduano
        17. HADOOP-12563.13.patch
          82 kB
          Matthew Paduano
        18. HADOOP-12563.14.patch
          82 kB
          Matthew Paduano
        19. HADOOP-12563.15.patch
          95 kB
          Matthew Paduano
        20. HADOOP-12563.16.patch
          95 kB
          Matthew Paduano

        Issue Links

          Activity

            People

              mattpaduano Matthew Paduano
              aw Allen Wittenauer
              Votes:
              0 Vote for this issue
              Watchers:
              20 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: