Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6891 Follow-on work for transparent data at rest encryption
  3. HDFS-6951

Correctly persist raw namespace xattrs to edit log and fsimage

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: 2.6.0
    • Component/s: encryption
    • Labels:
      None
    • Target Version/s:

      Description

      Currently, when users save namespace and restart the NameNode, pre-existing encryption zones will be wiped out.

      I could reproduce this on a pseudo-distributed cluster:

      • Create an encryption zone
      • List encryption zones and verify the newly created zone is present
      • Save the namespace
      • Kill and restart the NameNode
      • List the encryption zones and you'll find the encryption zone is missing

      I've attached a test case for TestEncryptionZones that reproduces this as well. Removing the saveNamespace call will get the test to pass.

        Attachments

        1. HDFS-6951-testrepo.patch
          2 kB
          Stephen Chu
        2. HDFS-6951.001.patch
          9 kB
          Charles Lamb
        3. HDFS-6951-prelim.002.patch
          11 kB
          Charles Lamb
        4. editsStored
          5 kB
          Charles Lamb
        5. HDFS-6951.002.patch
          11 kB
          Charles Lamb
        6. HDFS-6951.003.patch
          11 kB
          Charles Lamb
        7. HDFS-6951.004.patch
          12 kB
          Charles Lamb
        8. HDFS-6951.005.patch
          12 kB
          Charles Lamb
        9. HDFS-6951.006.patch
          12 kB
          Charles Lamb
        10. HDFS-6951-editsStored-binary
          5 kB
          Charles Lamb
        11. HDFS-6951.007.patch
          13 kB
          Charles Lamb

          Activity

            People

            • Assignee:
              clamb Charles Lamb
              Reporter:
              schu Stephen Chu
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: