Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8174

Update replication count to live rep count in fsck report

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: None
    • Labels:
    • Hadoop Flags:
      Reviewed

      Description

      When one of the replica is decommissioned , fetching fsck report gives "repl" count is one less than the total replica information displayed.

      blk_x len=y repl=3 [dn1, dn2, dn3, dn4]
      

      Update the description from "rep" to "Live_rep"

        Issue Links

          Activity

          Hide
          andreina J.Andreina added a comment -

          Attached an initial patch.
          Please review.

          Show
          andreina J.Andreina added a comment - Attached an initial patch. Please review.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 14m 40s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 javac 7m 27s There were no new javac warning messages.
          +1 javadoc 9m 35s There were no new javadoc warning messages.
          +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 7m 7s There were no new checkstyle issues.
          +1 install 1m 36s mvn install still works.
          +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse.
          +1 findbugs 3m 3s The patch does not introduce any new Findbugs (version 2.0.3) warnings.
          +1 native 3m 15s Pre-build of native portion
          -1 hdfs tests 175m 20s Tests failed in hadoop-hdfs.
              223m 1s  



          Reason Tests
          Failed unit tests hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate
            hadoop.hdfs.TestEncryptionZonesWithKMS
            hadoop.hdfs.web.TestWebHDFSXAttr



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12728161/HDFS-8174.1.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / f83c55a
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/10392/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/10392/testReport/
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/10392/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 14m 40s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 javac 7m 27s There were no new javac warning messages. +1 javadoc 9m 35s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 7m 7s There were no new checkstyle issues. +1 install 1m 36s mvn install still works. +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse. +1 findbugs 3m 3s The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 native 3m 15s Pre-build of native portion -1 hdfs tests 175m 20s Tests failed in hadoop-hdfs.     223m 1s   Reason Tests Failed unit tests hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate   hadoop.hdfs.TestEncryptionZonesWithKMS   hadoop.hdfs.web.TestWebHDFSXAttr Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12728161/HDFS-8174.1.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / f83c55a hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/10392/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/10392/testReport/ Console output https://builds.apache.org/job/PreCommit-HDFS-Build/10392/console This message was automatically generated.
          Hide
          andreina J.Andreina added a comment -

          Testcase failures are not related to this patch .
          Please review.

          Show
          andreina J.Andreina added a comment - Testcase failures are not related to this patch . Please review.
          Hide
          mingma Ming Ma added a comment -

          Thanks J.Andreina. LGTM.

          Show
          mingma Ming Ma added a comment - Thanks J.Andreina . LGTM.
          Hide
          umamaheswararao Uma Maheswara Rao G added a comment -

          +1, I will commit it shortly. Thanks Ming Ma for the review!

          Show
          umamaheswararao Uma Maheswara Rao G added a comment - +1, I will commit it shortly. Thanks Ming Ma for the review!
          Hide
          umamaheswararao Uma Maheswara Rao G added a comment -

          Committed to branch-2 and trunk. Thanks a lot, J.Andreina,

          Show
          umamaheswararao Uma Maheswara Rao G added a comment - Committed to branch-2 and trunk. Thanks a lot, J.Andreina,
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-trunk-Commit #7769 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7769/)
          HDFS-8174. Update replication count to live rep count in fsck report. Contributed by J.Andreina (umamahesh: rev 2ea0f2fc938febd7fbbe03656a91ae3db1409c50)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-trunk-Commit #7769 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7769/ ) HDFS-8174 . Update replication count to live rep count in fsck report. Contributed by J.Andreina (umamahesh: rev 2ea0f2fc938febd7fbbe03656a91ae3db1409c50) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Yarn-trunk #921 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/921/)
          HDFS-8174. Update replication count to live rep count in fsck report. Contributed by J.Andreina (umamahesh: rev 2ea0f2fc938febd7fbbe03656a91ae3db1409c50)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #921 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/921/ ) HDFS-8174 . Update replication count to live rep count in fsck report. Contributed by J.Andreina (umamahesh: rev 2ea0f2fc938febd7fbbe03656a91ae3db1409c50) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #190 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/190/)
          HDFS-8174. Update replication count to live rep count in fsck report. Contributed by J.Andreina (umamahesh: rev 2ea0f2fc938febd7fbbe03656a91ae3db1409c50)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #190 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/190/ ) HDFS-8174 . Update replication count to live rep count in fsck report. Contributed by J.Andreina (umamahesh: rev 2ea0f2fc938febd7fbbe03656a91ae3db1409c50) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2119 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2119/)
          HDFS-8174. Update replication count to live rep count in fsck report. Contributed by J.Andreina (umamahesh: rev 2ea0f2fc938febd7fbbe03656a91ae3db1409c50)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2119 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2119/ ) HDFS-8174 . Update replication count to live rep count in fsck report. Contributed by J.Andreina (umamahesh: rev 2ea0f2fc938febd7fbbe03656a91ae3db1409c50) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #179 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/179/)
          HDFS-8174. Update replication count to live rep count in fsck report. Contributed by J.Andreina (umamahesh: rev 2ea0f2fc938febd7fbbe03656a91ae3db1409c50)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #179 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/179/ ) HDFS-8174 . Update replication count to live rep count in fsck report. Contributed by J.Andreina (umamahesh: rev 2ea0f2fc938febd7fbbe03656a91ae3db1409c50) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2137 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2137/)
          HDFS-8174. Update replication count to live rep count in fsck report. Contributed by J.Andreina (umamahesh: rev 2ea0f2fc938febd7fbbe03656a91ae3db1409c50)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2137 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2137/ ) HDFS-8174 . Update replication count to live rep count in fsck report. Contributed by J.Andreina (umamahesh: rev 2ea0f2fc938febd7fbbe03656a91ae3db1409c50) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #189 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/189/)
          HDFS-8174. Update replication count to live rep count in fsck report. Contributed by J.Andreina (umamahesh: rev 2ea0f2fc938febd7fbbe03656a91ae3db1409c50)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #189 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/189/ ) HDFS-8174 . Update replication count to live rep count in fsck report. Contributed by J.Andreina (umamahesh: rev 2ea0f2fc938febd7fbbe03656a91ae3db1409c50) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java

            People

            • Assignee:
              andreina J.Andreina
              Reporter:
              andreina J.Andreina
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development