Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6891 Follow-on work for transparent data at rest encryption
  3. HDFS-6951

Correctly persist raw namespace xattrs to edit log and fsimage

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 2.6.0
    • encryption
    • None

    Description

      Currently, when users save namespace and restart the NameNode, pre-existing encryption zones will be wiped out.

      I could reproduce this on a pseudo-distributed cluster:

      • Create an encryption zone
      • List encryption zones and verify the newly created zone is present
      • Save the namespace
      • Kill and restart the NameNode
      • List the encryption zones and you'll find the encryption zone is missing

      I've attached a test case for TestEncryptionZones that reproduces this as well. Removing the saveNamespace call will get the test to pass.

      Attachments

        1. HDFS-6951.007.patch
          13 kB
          Charles Lamb
        2. HDFS-6951-editsStored-binary
          5 kB
          Charles Lamb
        3. HDFS-6951.006.patch
          12 kB
          Charles Lamb
        4. HDFS-6951.005.patch
          12 kB
          Charles Lamb
        5. HDFS-6951.004.patch
          12 kB
          Charles Lamb
        6. HDFS-6951.003.patch
          11 kB
          Charles Lamb
        7. HDFS-6951.002.patch
          11 kB
          Charles Lamb
        8. editsStored
          5 kB
          Charles Lamb
        9. HDFS-6951-prelim.002.patch
          11 kB
          Charles Lamb
        10. HDFS-6951.001.patch
          9 kB
          Charles Lamb
        11. HDFS-6951-testrepo.patch
          2 kB
          Stephen Chu

        Activity

          People

            clamb Charles Lamb
            schu Stephen Chu
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: