Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7835

make initial sleeptime in locateFollowingBlock configurable for DFSClient.

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.0
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: hdfs-client
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Make initial sleeptime in locateFollowingBlock configurable for DFSClient.
      Current the sleeptime/localTimeout in locateFollowingBlock/completeFile from DFSOutputStream is hard-coded as 400 ms, but retries can be configured by "dfs.client.block.write.locateFollowingBlock.retries". We should also make the initial sleeptime configurable to give user more flexibility to control both retry and delay.

      1. HDFS-7835.000.patch
        7 kB
        zhihai xu
      2. HDFS-7835.001.patch
        8 kB
        zhihai xu
      3. HDFS-7835.002.patch
        8 kB
        zhihai xu

        Activity

        Hide
        hadoopqa Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12700586/HDFS-7835.000.patch
        against trunk revision 9a37247.

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 1 new or modified test files.

        -1 javac. The applied patch generated 1155 javac compiler warnings (more than the trunk's current 185 warnings).

        -1 javadoc. The javadoc tool appears to have generated 47 warning messages.
        See https://builds.apache.org/job/PreCommit-HDFS-Build/9659//artifact/patchprocess/diffJavadocWarnings.txt for details.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9659//testReport/
        Javac warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/9659//artifact/patchprocess/diffJavacWarnings.txt
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9659//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12700586/HDFS-7835.000.patch against trunk revision 9a37247. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. -1 javac . The applied patch generated 1155 javac compiler warnings (more than the trunk's current 185 warnings). -1 javadoc . The javadoc tool appears to have generated 47 warning messages. See https://builds.apache.org/job/PreCommit-HDFS-Build/9659//artifact/patchprocess/diffJavadocWarnings.txt for details. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9659//testReport/ Javac warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/9659//artifact/patchprocess/diffJavacWarnings.txt Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9659//console This message is automatically generated.
        Hide
        yzhangal Yongjun Zhang added a comment -

        Hi zhihai xu,

        Thanks for your work on this jira. The patch looks good. Some nits:

        1. Suggest to change unit is ms, the initial delay for locateFollowingBlock, delay time to The initial delay (unit is ms) for locateFollowingBlock, the delay time
        2. There are two variables sleeptime and localTimeOut used for this delay, the former seems a better name for what it is, I think the latter can be changed the sleeptime to be more accurate.
        3. Need to add the config property to hdfs-default.xml.
        4. I also found some existing ones in DFSConfigKeys.java not put in hdfs-default.xml, e.g. dfs.client.block.write.locateFollowingBlock.retries. This can be fixed with a follow-up jira.

        Thanks.

        Show
        yzhangal Yongjun Zhang added a comment - Hi zhihai xu , Thanks for your work on this jira. The patch looks good. Some nits: Suggest to change unit is ms, the initial delay for locateFollowingBlock, delay time to The initial delay (unit is ms) for locateFollowingBlock, the delay time There are two variables sleeptime and localTimeOut used for this delay, the former seems a better name for what it is, I think the latter can be changed the sleeptime to be more accurate. Need to add the config property to hdfs-default.xml. I also found some existing ones in DFSConfigKeys.java not put in hdfs-default.xml, e.g. dfs.client.block.write.locateFollowingBlock.retries . This can be fixed with a follow-up jira. Thanks.
        Hide
        zxu zhihai xu added a comment -

        Hi Yongjun Zhang, thanks for your thorough review. I uploaded a mew patch HDFS-7835.001.patch which addressed all your comments.

        Show
        zxu zhihai xu added a comment - Hi Yongjun Zhang , thanks for your thorough review. I uploaded a mew patch HDFS-7835 .001.patch which addressed all your comments.
        Hide
        hadoopqa Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12704317/HDFS-7835.001.patch
        against trunk revision 8212877.

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 1 new or modified test files.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. There were no new javadoc warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs:

        org.apache.hadoop.hdfs.TestAppendSnapshotTruncate

        The following test timeouts occurred in hadoop-hdfs-project/hadoop-hdfs:

        org.apache.hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9867//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9867//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12704317/HDFS-7835.001.patch against trunk revision 8212877. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.TestAppendSnapshotTruncate The following test timeouts occurred in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9867//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9867//console This message is automatically generated.
        Hide
        yzhangal Yongjun Zhang added a comment -

        Hi zhihai xu,

        Thanks for the new rev and sorry for late reply. +1 after two more nits in hdfs-default.xml:

        1. change dfs.client.block.write.locateFollowingBlock.initial.delay to dfs.client.block.write.locateFollowingBlock.initial.delay.ms.
        2. change <description>the initial delay to <description>The initial delay

        Thanks.

        Show
        yzhangal Yongjun Zhang added a comment - Hi zhihai xu , Thanks for the new rev and sorry for late reply. +1 after two more nits in hdfs-default.xml: change dfs.client.block.write.locateFollowingBlock.initial.delay to dfs.client.block.write.locateFollowingBlock.initial.delay.ms . change <description>the initial delay to <description>The initial delay Thanks.
        Hide
        zxu zhihai xu added a comment -

        Hi Yongjun Zhang, thanks for the review. I uploaded a new patch HDFS-7835.002.patch which addressed all your comments. Please review it.

        Show
        zxu zhihai xu added a comment - Hi Yongjun Zhang , thanks for the review. I uploaded a new patch HDFS-7835 .002.patch which addressed all your comments. Please review it.
        Hide
        hadoopqa Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12705773/HDFS-7835.002.patch
        against trunk revision e37ca22.

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 1 new or modified test files.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. There were no new javadoc warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs:

        org.apache.hadoop.tracing.TestTracing
        org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
        org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9992//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9992//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12705773/HDFS-7835.002.patch against trunk revision e37ca22. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.tracing.TestTracing org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9992//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9992//console This message is automatically generated.
        Hide
        zxu zhihai xu added a comment -

        All these test failure are not related to my change.
        TestTracing is reported at HDFS-7963
        TestRetryCacheWithHA and TestEncryptionZonesWithKMS are passed at my latest local build:

        -------------------------------------------------------
         T E S T S
        -------------------------------------------------------
        Running org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
        Tests run: 22, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.994 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
        Results :
        Tests run: 22, Failures: 0, Errors: 0, Skipped: 0
        -------------------------------------------------------
         T E S T S
        -------------------------------------------------------
        Running org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS
        Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.67 sec - in org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS
        Results :
        Tests run: 19, Failures: 0, Errors: 0, Skipped: 0
        
        Show
        zxu zhihai xu added a comment - All these test failure are not related to my change. TestTracing is reported at HDFS-7963 TestRetryCacheWithHA and TestEncryptionZonesWithKMS are passed at my latest local build: ------------------------------------------------------- T E S T S ------------------------------------------------------- Running org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA Tests run: 22, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.994 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA Results : Tests run: 22, Failures: 0, Errors: 0, Skipped: 0 ------------------------------------------------------- T E S T S ------------------------------------------------------- Running org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.67 sec - in org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS Results : Tests run: 19, Failures: 0, Errors: 0, Skipped: 0
        Hide
        yzhangal Yongjun Zhang added a comment -

        Thanks zhihai xu.

        +1, and I will commit tomorrow.

        Show
        yzhangal Yongjun Zhang added a comment - Thanks zhihai xu . +1, and I will commit tomorrow.
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-trunk-Commit #7383 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7383/)
        HDFS-7835. make initial sleeptime in locateFollowingBlock configurable for DFSClient. Contributed by Zhihai Xu. (yzhang: rev 15612313f578a5115f8d03885e9b0c8c376ed56e)

        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #7383 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7383/ ) HDFS-7835 . make initial sleeptime in locateFollowingBlock configurable for DFSClient. Contributed by Zhihai Xu. (yzhang: rev 15612313f578a5115f8d03885e9b0c8c376ed56e) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
        Hide
        yzhangal Yongjun Zhang added a comment -

        Committed to trunk and branch-2. Thanks Zhihai Xu for the contribuation.

        Show
        yzhangal Yongjun Zhang added a comment - Committed to trunk and branch-2. Thanks Zhihai Xu for the contribuation.
        Hide
        zxu zhihai xu added a comment -

        thanks Yongjun Zhang for your review and commit.

        Show
        zxu zhihai xu added a comment - thanks Yongjun Zhang for your review and commit.
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #139 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/139/)
        HDFS-7835. make initial sleeptime in locateFollowingBlock configurable for DFSClient. Contributed by Zhihai Xu. (yzhang: rev 15612313f578a5115f8d03885e9b0c8c376ed56e)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #139 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/139/ ) HDFS-7835 . make initial sleeptime in locateFollowingBlock configurable for DFSClient. Contributed by Zhihai Xu. (yzhang: rev 15612313f578a5115f8d03885e9b0c8c376ed56e) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Yarn-trunk #873 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/873/)
        HDFS-7835. make initial sleeptime in locateFollowingBlock configurable for DFSClient. Contributed by Zhihai Xu. (yzhang: rev 15612313f578a5115f8d03885e9b0c8c376ed56e)

        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #873 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/873/ ) HDFS-7835 . make initial sleeptime in locateFollowingBlock configurable for DFSClient. Contributed by Zhihai Xu. (yzhang: rev 15612313f578a5115f8d03885e9b0c8c376ed56e) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk #2089 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2089/)
        HDFS-7835. make initial sleeptime in locateFollowingBlock configurable for DFSClient. Contributed by Zhihai Xu. (yzhang: rev 15612313f578a5115f8d03885e9b0c8c376ed56e)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2089 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2089/ ) HDFS-7835 . make initial sleeptime in locateFollowingBlock configurable for DFSClient. Contributed by Zhihai Xu. (yzhang: rev 15612313f578a5115f8d03885e9b0c8c376ed56e) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk #2071 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2071/)
        HDFS-7835. make initial sleeptime in locateFollowingBlock configurable for DFSClient. Contributed by Zhihai Xu. (yzhang: rev 15612313f578a5115f8d03885e9b0c8c376ed56e)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2071 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2071/ ) HDFS-7835 . make initial sleeptime in locateFollowingBlock configurable for DFSClient. Contributed by Zhihai Xu. (yzhang: rev 15612313f578a5115f8d03885e9b0c8c376ed56e) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #130 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/130/)
        HDFS-7835. make initial sleeptime in locateFollowingBlock configurable for DFSClient. Contributed by Zhihai Xu. (yzhang: rev 15612313f578a5115f8d03885e9b0c8c376ed56e)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #130 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/130/ ) HDFS-7835 . make initial sleeptime in locateFollowingBlock configurable for DFSClient. Contributed by Zhihai Xu. (yzhang: rev 15612313f578a5115f8d03885e9b0c8c376ed56e) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #139 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/139/)
        HDFS-7835. make initial sleeptime in locateFollowingBlock configurable for DFSClient. Contributed by Zhihai Xu. (yzhang: rev 15612313f578a5115f8d03885e9b0c8c376ed56e)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #139 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/139/ ) HDFS-7835 . make initial sleeptime in locateFollowingBlock configurable for DFSClient. Contributed by Zhihai Xu. (yzhang: rev 15612313f578a5115f8d03885e9b0c8c376ed56e) hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java

          People

          • Assignee:
            zxu zhihai xu
            Reporter:
            zxu zhihai xu
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development