Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4491 Encryption and Key Protection
  3. MAPREDUCE-5025

Key Distribution and Management for supporting crypto codec in Map Reduce

Add voteVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: security
    • Labels:
      None
    • Target Version/s:

      Description

      This task defines the work to enable Map Reduce to utilize the Crypto Codec framework to support encryption and decryption of data during MapReduce Job.

      According to the some real use case and discussions from the community, for encryption and decryption files in Map Reduce, we have the following requirements:
      1. Different stages (input, output, intermediate output) should have the flexibility to choose whether encrypt or not, as well as which crypto codec to use.
      2. Different stages may have different scheme of providing the keys.
      3. Different Files (for example, different input files) may have or use different keys.
      4. Support a flexible way of retrieving keys for encryption or decryption.

      So this task defines and provides the framework for supporting these requirements as well as the implementations for common use and key retrieving scenarios.

      The design document of this part is included in the Hadoop Crypto Design attached in HADOOP-9331.

        Attachments

        1. MAPREDUCE-5025.patch
          241 kB
          Haifeng Chen

        Issue Links

          Activity

            People

            • Assignee:
              jerrychenhf Haifeng Chen
              Reporter:
              jerrychenhf Haifeng Chen

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - 504h
                504h
                Remaining:
                Remaining Estimate - 504h
                504h
                Logged:
                Time Spent - Not Specified
                Not Specified

                  Issue deployment