Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13772

Erasure coding: Unnecessary NameNode Logs displaying for Enabling/Disabling Erasure coding policies which are already enabled/disabled

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Trivial
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 3.2.0, 3.0.4, 3.1.2
    • Component/s: erasure-coding
    • Labels:
      None
    • Environment:

      3 Node SuSE Linux cluster 

    • Hadoop Flags:
      Reviewed

      Description

      Unnecessary NameNode Logs displaying for Enabling/Disabling Erasure coding policies which are already enabled/disabled

      • Enable any Erasure coding policy like "RS-LEGACY-6-3-1024k"
      • Check the console log display as "Erasure coding policy RS-LEGACY-6-3-1024k is enabled"
      • Again try to enable the same policy multiple times "hdfs ec -enablePolicy -policy RS-LEGACY-6-3-1024k"
        instead of throwing error message as ""policy already enabled"" it will display same messages as "Erasure coding policy RS-LEGACY-6-3-1024k is enabled"
      • Also in NameNode log policy enabled logs are displaying multiple times unnecessarily even though the policy is already enabled.
        like this : 2018-07-27 18:50:35,084 INFO org.apache.hadoop.hdfs.server.namenode.ErasureCodingPolicyManager: Disable the erasure coding policy RS-10-4-1024k
        2018-07-27 18:50:35,084 INFO org.apache.hadoop.hdfs.server.namenode.ErasureCodingPolicyManager: Disable the erasure coding policy RS-10-4-1024k
        2018-07-27 18:50:35,084 INFO org.apache.hadoop.hdfs.server.namenode.ErasureCodingPolicyManager: Disable the erasure coding policy RS-10-4-1024k
        2018-07-27 18:50:35,084 INFO org.apache.hadoop.hdfs.server.namenode.ErasureCodingPolicyManager: Enable the erasure coding policy RS-LEGACY-6-3-1024k
        2018-07-27 18:50:35,084 INFO org.apache.hadoop.hdfs.server.namenode.ErasureCodingPolicyManager: Enable the erasure coding policy RS-LEGACY-6-3-1024k
        2018-07-27 18:50:35,084 INFO org.apache.hadoop.hdfs.server.namenode.ErasureCodingPolicyManager: Enable the erasure coding policy RS-LEGACY-6-3-1024k
      • While executing the Erasure coding policy disable command also same type of logs coming multiple times even though the policy is already
        disabled.It should throw error message as ""policy is already disabled"" for already disabled policy.

        Attachments

        1. EC_capture1.PNG
          24 kB
          Souryakanta Dwivedy
        2. HDFS-13772-01.patch
          30 kB
          Ayush Saxena
        3. HDFS-13772-02.patch
          6 kB
          Ayush Saxena
        4. HDFS-13772-03 .patch
          11 kB
          Ayush Saxena
        5. HDFS-13772-04.patch
          11 kB
          Ayush Saxena
        6. HDFS-13772-05.patch
          11 kB
          Ayush Saxena
        7. HDFS-13772-06.patch
          11 kB
          Ayush Saxena
        8. HDFS-13772-07.patch
          11 kB
          Ayush Saxena

          Activity

            People

            • Assignee:
              ayushtkn Ayush Saxena
              Reporter:
              SouryakantaDwivedy Souryakanta Dwivedy
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: