Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12563

Updated utility to create/modify token files

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      This feature introduces a new command called "hadoop dtutil" which lets users request and download delegation tokens with certain attributes.

      Description

      hdfs fetchdt is missing some critical features and is geared almost exclusively towards HDFS operations. Additionally, the token files that are created use Java serializations which are hard/impossible to deal with in other languages. It should be replaced with a better utility in common that can read/write protobuf-based token files, has enough flexibility to be used with other services, and offers key functionality such as append and rename. The old version file format should still be supported for backward compatibility, but will be effectively deprecated.

      A follow-on JIRA will deprecrate fetchdt.

        Attachments

        1. HADOOP-12563.16.patch
          95 kB
          Matthew Paduano
        2. HADOOP-12563.15.patch
          95 kB
          Matthew Paduano
        3. HADOOP-12563.14.patch
          82 kB
          Matthew Paduano
        4. HADOOP-12563.13.patch
          82 kB
          Matthew Paduano
        5. HADOOP-12563.12.patch
          82 kB
          Matthew Paduano
        6. HADOOP-12563.11.patch
          81 kB
          Matthew Paduano
        7. HADOOP-12563.10.patch
          81 kB
          Matthew Paduano
        8. HADOOP-12563.09.patch
          74 kB
          Matthew Paduano
        9. HADOOP-12563.08.patch
          69 kB
          Matthew Paduano
        10. HADOOP-12563.07.patch
          68 kB
          Allen Wittenauer
        11. dtutil-test-out
          18 kB
          Matthew Paduano
        12. HADOOP-12563.07.patch
          68 kB
          Matthew Paduano
        13. HADOOP-12563.06.patch
          59 kB
          Matthew Paduano
        14. HADOOP-12563.05.patch
          58 kB
          Matthew Paduano
        15. HADOOP-12563.04.patch
          58 kB
          Matthew Paduano
        16. example_dtutil_commands_and_output.txt
          17 kB
          Matthew Paduano
        17. generalized_token_case.pdf
          65 kB
          Matthew Paduano
        18. HADOOP-12563.03.patch
          53 kB
          Matthew Paduano
        19. HADOOP-12563.02.patch
          52 kB
          Matthew Paduano
        20. HADOOP-12563.01.patch
          52 kB
          Matthew Paduano

          Issue Links

            Activity

              People

              • Assignee:
                mattpaduano Matthew Paduano
                Reporter:
                aw Allen Wittenauer
              • Votes:
                0 Vote for this issue
                Watchers:
                21 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: