Details

    • Hadoop Flags:
      Reviewed

      Description

      Block State Change logs are too noisy at the default INFO level and affect NN performance on busy clusters.

      Most of these state changes can be logged at debug level instead.

      1. HDFS6860.patch
        11 kB
        Chang Li
      2. HDFS6860.patch
        13 kB
        Chang Li
      3. HDFS-6860.00.patch
        14 kB
        Xiaoyu Yao
      4. HDFS-6860.01.patch
        12 kB
        Xiaoyu Yao
      5. HDFS-6860.branch-2.6.patch
        97 kB
        Xiaoyu Yao

        Issue Links

          Activity

          Hide
          lichangleo Chang Li added a comment -

          Arpit Agarwalcould you assign me the ticket?

          Show
          lichangleo Chang Li added a comment - Arpit Agarwal could you assign me the ticket?
          Hide
          lichangleo Chang Li added a comment -

          have changed most of the blockstatechange log from info level to debug level.

          Show
          lichangleo Chang Li added a comment - have changed most of the blockstatechange log from info level to debug level.
          Hide
          arpitagarwal Arpit Agarwal added a comment -

          Thanks for fixing this Chang Li. Can you also wrap each call in a isDebugEnabled() call. That way we don't incur the overhead of generating the log strings unless debug logging is turned on. e.g.

              if (NameNode.blockStateChangeLog.isDebugEnabled()) {
                  NameNode.blockStateChangeLog.debug("BLOCK* Removing stale replica "
                       + "from location: " + r.getExpectedStorageLocation());
              }
          
          Show
          arpitagarwal Arpit Agarwal added a comment - Thanks for fixing this Chang Li . Can you also wrap each call in a isDebugEnabled() call. That way we don't incur the overhead of generating the log strings unless debug logging is turned on. e.g. if (NameNode.blockStateChangeLog.isDebugEnabled()) { NameNode.blockStateChangeLog.debug( "BLOCK* Removing stale replica " + "from location: " + r.getExpectedStorageLocation()); }
          Hide
          andrew.wang Andrew Wang added a comment -

          Is this a good time to also switch BlockStateChange over to use slf4j and to use "{}" templates? Then we could avoid the if-wrappers.

          Show
          andrew.wang Andrew Wang added a comment - Is this a good time to also switch BlockStateChange over to use slf4j and to use "{}" templates? Then we could avoid the if-wrappers.
          Hide
          arpitagarwal Arpit Agarwal added a comment -

          Chang Li, see if you want to follow Andrew's suggestion and update BlockStateChange to use slf4j.

          I'd be +1 either way - slf4j or existing log4j calls with isDebugEnabled checks.

          Show
          arpitagarwal Arpit Agarwal added a comment - Chang Li , see if you want to follow Andrew's suggestion and update BlockStateChange to use slf4j. I'd be +1 either way - slf4j or existing log4j calls with isDebugEnabled checks.
          Hide
          lichangleo Chang Li added a comment -

          updated patch with debugenable check

          Show
          lichangleo Chang Li added a comment - updated patch with debugenable check
          Hide
          arpitagarwal Arpit Agarwal added a comment -

          Thanks Chang.

          1. In logAddStoredBlock, we can just fix the call to if (!blockLog.isInfoEnabled()) at the start of the function. Then we skip the unnecessary StringBuilder logic.
          2. Looks like patch needs to be rebased to current trunk.

          +1 with these fixed.

          Show
          arpitagarwal Arpit Agarwal added a comment - Thanks Chang. In logAddStoredBlock , we can just fix the call to if (!blockLog.isInfoEnabled()) at the start of the function. Then we skip the unnecessary StringBuilder logic. Looks like patch needs to be rebased to current trunk. +1 with these fixed.
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12665129/HDFS6860.patch
          against trunk revision d9a7404.

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7842//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12665129/HDFS6860.patch against trunk revision d9a7404. -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7842//console This message is automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          -1 patch 0m 0s The patch command could not apply the patch during dryrun.



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12665129/HDFS6860.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / f1a152c
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/10643/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 patch 0m 0s The patch command could not apply the patch during dryrun. Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12665129/HDFS6860.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / f1a152c Console output https://builds.apache.org/job/PreCommit-HDFS-Build/10643/console This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          -1 patch 0m 0s The patch command could not apply the patch during dryrun.



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12665129/HDFS6860.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / f1a152c
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/10655/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 patch 0m 0s The patch command could not apply the patch during dryrun. Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12665129/HDFS6860.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / f1a152c Console output https://builds.apache.org/job/PreCommit-HDFS-Build/10655/console This message was automatically generated.
          Hide
          xyao Xiaoyu Yao added a comment -

          The original patch does not apply after switching to slf4j with HDFS-7112. I rebase and fix some missing ones in the original patch.

          Show
          xyao Xiaoyu Yao added a comment - The original patch does not apply after switching to slf4j with HDFS-7112 . I rebase and fix some missing ones in the original patch.
          Hide
          arpitagarwal Arpit Agarwal added a comment -

          Thanks Xiaoyu Yao, we should probably leave the "Processing first storage report for " and the processReport messages at DEBUG.

          Those are logged once per DN per block report and useful in practice.

          .

          Show
          arpitagarwal Arpit Agarwal added a comment - Thanks Xiaoyu Yao , we should probably leave the "Processing first storage report for " and the processReport messages at DEBUG. Those are logged once per DN per block report and useful in practice. .
          Hide
          xyao Xiaoyu Yao added a comment -

          Thanks Arpit Agarwal for the review. Do you mean keep the processReport related log at INFO level?

          Show
          xyao Xiaoyu Yao added a comment - Thanks Arpit Agarwal for the review. Do you mean keep the processReport related log at INFO level?
          Hide
          arpitagarwal Arpit Agarwal added a comment -

          Thanks I meant INFO. Apologize for not catching this in the earlier review.

          Show
          arpitagarwal Arpit Agarwal added a comment - Thanks I meant INFO. Apologize for not catching this in the earlier review.
          Hide
          xyao Xiaoyu Yao added a comment -

          Update the patch based on feedback.
          Delta from v00: Keep the block report processing related log at INFO level.

          Show
          xyao Xiaoyu Yao added a comment - Update the patch based on feedback. Delta from v00: Keep the block report processing related log at INFO level.
          Hide
          arpitagarwal Arpit Agarwal added a comment -

          +1 pending Jenkins thanks for taking over this Xiaoyu Yao.

          Show
          arpitagarwal Arpit Agarwal added a comment - +1 pending Jenkins thanks for taking over this Xiaoyu Yao .
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 18m 58s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 javac 8m 16s There were no new javac warning messages.
          +1 javadoc 10m 31s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 1m 29s There were no new checkstyle issues.
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 install 1m 20s mvn install still works.
          +1 eclipse:eclipse 0m 35s The patch built with eclipse:eclipse.
          +1 findbugs 2m 43s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 native 3m 6s Pre-build of native portion
          -1 hdfs tests 157m 31s Tests failed in hadoop-hdfs.
              204m 56s  



          Reason Tests
          Failed unit tests hadoop.hdfs.server.namenode.ha.TestStandbyIsHot
          Timed out tests org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12748221/HDFS-6860.00.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / d0e0ba8
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/11879/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/11879/testReport/
          Java 1.7.0_55
          uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/11879/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 18m 58s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 8m 16s There were no new javac warning messages. +1 javadoc 10m 31s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 1m 29s There were no new checkstyle issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 20s mvn install still works. +1 eclipse:eclipse 0m 35s The patch built with eclipse:eclipse. +1 findbugs 2m 43s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 3m 6s Pre-build of native portion -1 hdfs tests 157m 31s Tests failed in hadoop-hdfs.     204m 56s   Reason Tests Failed unit tests hadoop.hdfs.server.namenode.ha.TestStandbyIsHot Timed out tests org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12748221/HDFS-6860.00.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / d0e0ba8 hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/11879/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/11879/testReport/ Java 1.7.0_55 uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/11879/console This message was automatically generated.
          Hide
          xyao Xiaoyu Yao added a comment -

          Jenkins results:

          • No unit test added because this is a log level only change.
          • Test failure is unrelated and tracked by know JIRAs: HDFS-8772.

          Thanks Chang Li for the initial patch and Arpit Agarwal, Andrew Wang for the review. I commit the patch shortly.

          Show
          xyao Xiaoyu Yao added a comment - Jenkins results: No unit test added because this is a log level only change. Test failure is unrelated and tracked by know JIRAs: HDFS-8772 . Thanks Chang Li for the initial patch and Arpit Agarwal , Andrew Wang for the review. I commit the patch shortly.
          Hide
          xyao Xiaoyu Yao added a comment -

          commit to 2.8.0

          Show
          xyao Xiaoyu Yao added a comment - commit to 2.8.0
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #8253 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8253/)
          HDFS-6860. BlockStateChange logs are too noisy. Contributed by Chang Li and Xiaoyu Yao. (xyao: rev d311a38a6b32bbb210bd8748cfb65463e9c0740e)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/CorruptReplicasMap.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/InvalidateBlocks.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfoUnderConstruction.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8253 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8253/ ) HDFS-6860 . BlockStateChange logs are too noisy. Contributed by Chang Li and Xiaoyu Yao. (xyao: rev d311a38a6b32bbb210bd8748cfb65463e9c0740e) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/CorruptReplicasMap.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/InvalidateBlocks.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfoUnderConstruction.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #1004 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1004/)
          HDFS-6860. BlockStateChange logs are too noisy. Contributed by Chang Li and Xiaoyu Yao. (xyao: rev d311a38a6b32bbb210bd8748cfb65463e9c0740e)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/CorruptReplicasMap.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfoUnderConstruction.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/InvalidateBlocks.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #1004 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1004/ ) HDFS-6860 . BlockStateChange logs are too noisy. Contributed by Chang Li and Xiaoyu Yao. (xyao: rev d311a38a6b32bbb210bd8748cfb65463e9c0740e) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/CorruptReplicasMap.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfoUnderConstruction.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/InvalidateBlocks.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #274 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/274/)
          HDFS-6860. BlockStateChange logs are too noisy. Contributed by Chang Li and Xiaoyu Yao. (xyao: rev d311a38a6b32bbb210bd8748cfb65463e9c0740e)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfoUnderConstruction.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/InvalidateBlocks.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/CorruptReplicasMap.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #274 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/274/ ) HDFS-6860 . BlockStateChange logs are too noisy. Contributed by Chang Li and Xiaoyu Yao. (xyao: rev d311a38a6b32bbb210bd8748cfb65463e9c0740e) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfoUnderConstruction.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/InvalidateBlocks.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/CorruptReplicasMap.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2220 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2220/)
          HDFS-6860. BlockStateChange logs are too noisy. Contributed by Chang Li and Xiaoyu Yao. (xyao: rev d311a38a6b32bbb210bd8748cfb65463e9c0740e)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfoUnderConstruction.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/CorruptReplicasMap.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/InvalidateBlocks.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2220 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2220/ ) HDFS-6860 . BlockStateChange logs are too noisy. Contributed by Chang Li and Xiaoyu Yao. (xyao: rev d311a38a6b32bbb210bd8748cfb65463e9c0740e) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfoUnderConstruction.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/CorruptReplicasMap.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/InvalidateBlocks.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2201 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2201/)
          HDFS-6860. BlockStateChange logs are too noisy. Contributed by Chang Li and Xiaoyu Yao. (xyao: rev d311a38a6b32bbb210bd8748cfb65463e9c0740e)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/CorruptReplicasMap.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfoUnderConstruction.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/InvalidateBlocks.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2201 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2201/ ) HDFS-6860 . BlockStateChange logs are too noisy. Contributed by Chang Li and Xiaoyu Yao. (xyao: rev d311a38a6b32bbb210bd8748cfb65463e9c0740e) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/CorruptReplicasMap.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfoUnderConstruction.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/InvalidateBlocks.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #263 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/263/)
          HDFS-6860. BlockStateChange logs are too noisy. Contributed by Chang Li and Xiaoyu Yao. (xyao: rev d311a38a6b32bbb210bd8748cfb65463e9c0740e)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/CorruptReplicasMap.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfoUnderConstruction.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/InvalidateBlocks.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #263 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/263/ ) HDFS-6860 . BlockStateChange logs are too noisy. Contributed by Chang Li and Xiaoyu Yao. (xyao: rev d311a38a6b32bbb210bd8748cfb65463e9c0740e) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/CorruptReplicasMap.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfoUnderConstruction.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/InvalidateBlocks.java
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #271 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/271/)
          HDFS-6860. BlockStateChange logs are too noisy. Contributed by Chang Li and Xiaoyu Yao. (xyao: rev d311a38a6b32bbb210bd8748cfb65463e9c0740e)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/InvalidateBlocks.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfoUnderConstruction.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/CorruptReplicasMap.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #271 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/271/ ) HDFS-6860 . BlockStateChange logs are too noisy. Contributed by Chang Li and Xiaoyu Yao. (xyao: rev d311a38a6b32bbb210bd8748cfb65463e9c0740e) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/InvalidateBlocks.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfoUnderConstruction.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/CorruptReplicasMap.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
          Hide
          xyao Xiaoyu Yao added a comment -

          Attach a 2.6 patch that includes HDFS-6860 and slf4j changes HDFS-7706, HDFS-7712 and HADOOP-11430.

          Show
          xyao Xiaoyu Yao added a comment - Attach a 2.6 patch that includes HDFS-6860 and slf4j changes HDFS-7706 , HDFS-7712 and HADOOP-11430 .

            People

            • Assignee:
              lichangleo Chang Li
              Reporter:
              arpitagarwal Arpit Agarwal
            • Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development