Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5890

Support for encrypting Intermediate data and spills in local filesystem

    Details

    • Hadoop Flags:
      Reviewed

      Description

      For some sensitive data, encryption while in flight (network) is not sufficient, it is required that while at rest it should be encrypted. HADOOP-10150 & HDFS-6134 bring encryption at rest for data in filesystem using Hadoop FileSystem API. MapReduce intermediate data and spills should also be encrypted while at rest.

      1. syslog.tar.gz
        463 kB
        Arun Suresh
      2. org.apache.hadoop.mapred.TestMRIntermediateDataEncryption-output.txt
        586 kB
        Arun Suresh
      3. MAPREDUCE-5890.9.patch
        74 kB
        Arun Suresh
      4. MAPREDUCE-5890.8.patch
        158 kB
        Arun Suresh
      5. MAPREDUCE-5890.7.patch
        158 kB
        Arun Suresh
      6. MAPREDUCE-5890.6.patch
        71 kB
        Arun Suresh
      7. MAPREDUCE-5890.5.patch
        72 kB
        Arun Suresh
      8. MAPREDUCE-5890.4.patch
        68 kB
        Arun Suresh
      9. MAPREDUCE-5890.3.patch
        66 kB
        Arun Suresh
      10. MAPREDUCE-5890.15.patch
        58 kB
        Arun Suresh
      11. MAPREDUCE-5890.14.patch
        58 kB
        Arun Suresh
      12. MAPREDUCE-5890.13.patch
        58 kB
        Arun Suresh
      13. MAPREDUCE-5890.12.patch
        58 kB
        Arun Suresh
      14. MAPREDUCE-5890.11.patch
        58 kB
        Arun Suresh
      15. MAPREDUCE-5890.10.patch
        59 kB
        Arun Suresh

        Issue Links

          Activity

          Alejandro Abdelnur created issue -
          Alejandro Abdelnur made changes -
          Field Original Value New Value
          Assignee Alejandro Abdelnur [ tucu00 ] Arun Suresh [ asuresh ]
          Arun Suresh made changes -
          Attachment MAPREDUCE-5890.1.patch [ 12650964 ]
          Arun Suresh made changes -
          Labels encryption
          Arun Suresh made changes -
          Attachment MAPREDUCE-5890.2.patch [ 12650967 ]
          Arun Suresh made changes -
          Attachment MAPREDUCE-5890.1.patch [ 12650964 ]
          Arun Suresh made changes -
          Attachment MAPREDUCE-5890.test.patch [ 12650972 ]
          Arun Suresh made changes -
          Attachment MAPREDUCE-5890.3.patch [ 12651375 ]
          Arun Suresh made changes -
          Attachment MAPREDUCE-5890.test.patch [ 12650972 ]
          Arun Suresh made changes -
          Attachment MAPREDUCE-5890.2.patch [ 12650967 ]
          Arun Suresh made changes -
          Arun Suresh made changes -
          Attachment MAPREDUCE-5890.4.patch [ 12652166 ]
          Arun Suresh made changes -
          Attachment MAPREDUCE-5890.5.patch [ 12652388 ]
          Arun Suresh made changes -
          Attachment MAPREDUCE-5890.6.patch [ 12652458 ]
          Arun Suresh made changes -
          Attachment MAPREDUCE-5890.7.patch [ 12652475 ]
          Arun Suresh made changes -
          Attachment MAPREDUCE-5890.8.patch [ 12652482 ]
          Arun Suresh made changes -
          Attachment MAPREDUCE-5890.9.patch [ 12652503 ]
          Arun Suresh made changes -
          Attachment MAPREDUCE-5890.10.patch [ 12652523 ]
          Arun Suresh made changes -
          Attachment MAPREDUCE-5890.11.patch [ 12652595 ]
          Arun Suresh made changes -
          Attachment MAPREDUCE-5890.12.patch [ 12652673 ]
          Arun Suresh made changes -
          Status Open [ 1 ] In Progress [ 3 ]
          Arun Suresh made changes -
          Attachment MAPREDUCE-5890.13.patch [ 12654715 ]
          Arun Suresh made changes -
          Attachment MAPREDUCE-5890.14.patch [ 12654870 ]
          Arun Suresh made changes -
          Attachment MAPREDUCE-5890.15.patch [ 12655116 ]
          Alejandro Abdelnur made changes -
          Status In Progress [ 3 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s fs-encryption [ 12327362 ]
          Resolution Fixed [ 1 ]
          Allen Wittenauer made changes -
          Link This issue relates to MAPREDUCE-6257 [ MAPREDUCE-6257 ]
          Allen Wittenauer made changes -
          Fix Version/s 2.6.0 [ 12327180 ]
          Vinod Kumar Vavilapalli made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Arun Suresh
              Reporter:
              Alejandro Abdelnur
            • Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development