Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-9997

Improve TFile API to be able to pass the context for encryption codecs

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.0.0-alpha1
    • None
    • io

    Description

      HADOOP-9996 extends TFile to support any compression codecs available in Hadoop, such as Snappy. This also provides the opportunity to utilize the crypto codec for encryption, a new feature added by HADOOP-9331. The crypto codec is based on the compression codec and it is a natural extension of its usage here. While in API level encryption usually needs a key context while compression usually doesn’t.

      This work needs to extend the TFile Reader and Writer to passing and handling a context of the codec. For crypto codecs, this may be the key information for using to encrypt or decrypt the data. To keep the backward compatibility of the reader and writer, new methods or constructor with codec context can be added instead of modifying the existing methods.

      Attachments

        1. HADOOP-9997.patch
          13 kB
          Haifeng Chen

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            jerrychenhf Haifeng Chen

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - 72h
                72h
                Remaining:
                Remaining Estimate - 72h
                72h
                Logged:
                Time Spent - Not Specified
                Not Specified

                Slack

                  Issue deployment