Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4491 Encryption and Key Protection
  3. MAPREDUCE-5025

Key Distribution and Management for supporting crypto codec in Map Reduce

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: security
    • Labels:
      None
    • Target Version/s:

      Description

      This task defines the work to enable Map Reduce to utilize the Crypto Codec framework to support encryption and decryption of data during MapReduce Job.

      According to the some real use case and discussions from the community, for encryption and decryption files in Map Reduce, we have the following requirements:
      1. Different stages (input, output, intermediate output) should have the flexibility to choose whether encrypt or not, as well as which crypto codec to use.
      2. Different stages may have different scheme of providing the keys.
      3. Different Files (for example, different input files) may have or use different keys.
      4. Support a flexible way of retrieving keys for encryption or decryption.

      So this task defines and provides the framework for supporting these requirements as well as the implementations for common use and key retrieving scenarios.

      The design document of this part is included in the Hadoop Crypto Design attached in HADOOP-9331.

        Attachments

        1. MAPREDUCE-5025.patch
          241 kB
          Haifeng Chen

          Issue Links

            Activity

              People

              • Assignee:
                jerrychenhf Haifeng Chen
                Reporter:
                jerrychenhf Haifeng Chen
              • Votes:
                0 Vote for this issue
                Watchers:
                29 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - 504h
                  504h
                  Remaining:
                  Remaining Estimate - 504h
                  504h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified