Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11633

FSImage failover disables all erasure coding policies

    XMLWordPrintableJSON

    Details

      Description

      If NameNode fails to load the fsimage in the first NameNode metadata directory, it accidentally clears all enabled erasure coding policies in ErasureCodingPolicyManager.

      Even if the NameNode configures multiple fsimage metadata directory and it successfully loads the second one, enabled erasure coding policies are not restored.

      In the current implementation, we do not have a ErasureCodingPolicyManager section in fsimage, so a fsimage reload does not reload ECPM.

      The easiest fix before ECPM section is implemented, is don't clear ECPM when FSNamesystem is cleared.

        Attachments

        1. HDFS-11633.001.patch
          4 kB
          Wei-Chiu Chuang
        2. HDFS-11633.002.patch
          4 kB
          Wei-Chiu Chuang
        3. HDFS-11633.test.patch
          4 kB
          Wei-Chiu Chuang

          Activity

            People

            • Assignee:
              weichiu Wei-Chiu Chuang
              Reporter:
              weichiu Wei-Chiu Chuang
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: