Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12447

Rename AddECPolicyResponse to AddErasureCodingPolicyResponse

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0-beta1
    • Component/s: None
    • Hadoop Flags:
      Incompatible change
    • Release Note:
      HdfsAdmin#addErasureCodingPolicies now returns an AddErasureCodingPolicyResponse[] rather than AddECPolicyResponse[]. The corresponding RPC definition and PB message have also been renamed.

      Description

      As a follow on to handle some issues discussed in HDFS-12395, this is to majorly refactor addErasureCodingPoliy API, change AddECPolicyResponse => AddErasureCodingPolicyResponse

      1. HDFS-12447.004.patch
        31 kB
        SammiChen
      2. HDFS-12447.003.patch
        31 kB
        Kai Zheng
      3. HDFS-12447.002.patch
        32 kB
        SammiChen
      4. HDFS-12447.001.patch
        31 kB
        SammiChen

        Activity

        Hide
        Sammi SammiChen added a comment -

        Improve the patch after offline discussion with Kai.

        Show
        Sammi SammiChen added a comment - Improve the patch after offline discussion with Kai.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 34s Docker mode activated.
              Prechecks
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 5 new or modified test files.
              trunk Compile Tests
        0 mvndep 0m 40s Maven dependency ordering for branch
        +1 mvninstall 31m 55s trunk passed
        +1 compile 4m 48s trunk passed
        +1 checkstyle 1m 56s trunk passed
        +1 mvnsite 3m 42s trunk passed
        +1 findbugs 7m 3s trunk passed
        +1 javadoc 2m 39s trunk passed
              Patch Compile Tests
        0 mvndep 0m 18s Maven dependency ordering for patch
        +1 mvninstall 3m 42s the patch passed
        +1 compile 3m 41s the patch passed
        +1 cc 3m 41s the patch passed
        +1 javac 3m 41s the patch passed
        -0 checkstyle 1m 48s hadoop-hdfs-project: The patch generated 1 new + 626 unchanged - 0 fixed = 627 total (was 626)
        +1 mvnsite 3m 40s the patch passed
        +1 whitespace 0m 1s The patch has no whitespace issues.
        +1 findbugs 11m 17s the patch passed
        +1 javadoc 2m 31s the patch passed
              Other Tests
        +1 unit 5m 9s hadoop-hdfs-client in the patch passed.
        -1 unit 195m 29s hadoop-hdfs in the patch failed.
        -1 asflicense 1m 18s The patch generated 1 ASF License warnings.
        287m 46s



        Reason Tests
        Failed junit tests hadoop.hdfs.TestDFSStripedOutputStreamWithFailure110
          hadoop.hdfs.TestDFSShell
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure180
          hadoop.hdfs.server.datanode.TestDirectoryScanner
          hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure140
          hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure000
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure100
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure060
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure090
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure210
          hadoop.hdfs.TestReadStripedFileWithMissingBlocks
          hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure010
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure130
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure200
          hadoop.hdfs.TestReconstructStripedFile
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure170
          hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
          hadoop.hdfs.server.datanode.TestDataNodeUUID
          hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
          hadoop.hdfs.security.TestDelegationTokenForProxyUser
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure050
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure040
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure190
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure020
          hadoop.hdfs.TestLeaseRecoveryStriped
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure070
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure160
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure030
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure120
          hadoop.hdfs.server.namenode.TestNamenodeRetryCache
          hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
        Timed out junit tests org.apache.hadoop.hdfs.TestFileChecksum
          org.apache.hadoop.hdfs.TestReadStripedFileWithDecodingCorruptData
          org.apache.hadoop.hdfs.TestReadStripedFileWithDNFailure
          org.apache.hadoop.hdfs.TestWriteReadStripedFile
          org.apache.hadoop.hdfs.TestDFSStripedOutputStream
          org.apache.hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean
          org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080
          org.apache.hadoop.hdfs.TestReadStripedFileWithDecodingDeletedData
          org.apache.hadoop.hdfs.TestErasureCodeBenchmarkThroughput



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:71bbb86
        JIRA Issue HDFS-12447
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887261/HDFS-12447.001.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc
        uname Linux 6558eb08e9be 3.13.0-129-generic #178-Ubuntu SMP Fri Aug 11 12:48:20 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 50764ef
        Default Java 1.8.0_144
        findbugs v3.1.0-RC1
        checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/21154/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/21154/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/21154/testReport/
        asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/21154/artifact/patchprocess/patch-asflicense-problems.txt
        modules C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/21154/console
        Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 34s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 5 new or modified test files.       trunk Compile Tests 0 mvndep 0m 40s Maven dependency ordering for branch +1 mvninstall 31m 55s trunk passed +1 compile 4m 48s trunk passed +1 checkstyle 1m 56s trunk passed +1 mvnsite 3m 42s trunk passed +1 findbugs 7m 3s trunk passed +1 javadoc 2m 39s trunk passed       Patch Compile Tests 0 mvndep 0m 18s Maven dependency ordering for patch +1 mvninstall 3m 42s the patch passed +1 compile 3m 41s the patch passed +1 cc 3m 41s the patch passed +1 javac 3m 41s the patch passed -0 checkstyle 1m 48s hadoop-hdfs-project: The patch generated 1 new + 626 unchanged - 0 fixed = 627 total (was 626) +1 mvnsite 3m 40s the patch passed +1 whitespace 0m 1s The patch has no whitespace issues. +1 findbugs 11m 17s the patch passed +1 javadoc 2m 31s the patch passed       Other Tests +1 unit 5m 9s hadoop-hdfs-client in the patch passed. -1 unit 195m 29s hadoop-hdfs in the patch failed. -1 asflicense 1m 18s The patch generated 1 ASF License warnings. 287m 46s Reason Tests Failed junit tests hadoop.hdfs.TestDFSStripedOutputStreamWithFailure110   hadoop.hdfs.TestDFSShell   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure180   hadoop.hdfs.server.datanode.TestDirectoryScanner   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure140   hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure000   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure100   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure060   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure090   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure210   hadoop.hdfs.TestReadStripedFileWithMissingBlocks   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure010   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure130   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure200   hadoop.hdfs.TestReconstructStripedFile   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure170   hadoop.hdfs.server.namenode.ha.TestPipelinesFailover   hadoop.hdfs.server.datanode.TestDataNodeUUID   hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics   hadoop.hdfs.security.TestDelegationTokenForProxyUser   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure050   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure040   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure190   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure020   hadoop.hdfs.TestLeaseRecoveryStriped   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure070   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure160   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure030   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure120   hadoop.hdfs.server.namenode.TestNamenodeRetryCache   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure Timed out junit tests org.apache.hadoop.hdfs.TestFileChecksum   org.apache.hadoop.hdfs.TestReadStripedFileWithDecodingCorruptData   org.apache.hadoop.hdfs.TestReadStripedFileWithDNFailure   org.apache.hadoop.hdfs.TestWriteReadStripedFile   org.apache.hadoop.hdfs.TestDFSStripedOutputStream   org.apache.hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean   org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080   org.apache.hadoop.hdfs.TestReadStripedFileWithDecodingDeletedData   org.apache.hadoop.hdfs.TestErasureCodeBenchmarkThroughput Subsystem Report/Notes Docker Image:yetus/hadoop:71bbb86 JIRA Issue HDFS-12447 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887261/HDFS-12447.001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc uname Linux 6558eb08e9be 3.13.0-129-generic #178-Ubuntu SMP Fri Aug 11 12:48:20 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 50764ef Default Java 1.8.0_144 findbugs v3.1.0-RC1 checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/21154/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/21154/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/21154/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/21154/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project Console output https://builds.apache.org/job/PreCommit-HDFS-Build/21154/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 25s Docker mode activated.
              Prechecks
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 5 new or modified test files.
              trunk Compile Tests
        0 mvndep 0m 25s Maven dependency ordering for branch
        +1 mvninstall 14m 14s trunk passed
        +1 compile 2m 3s trunk passed
        +1 checkstyle 1m 0s trunk passed
        +1 mvnsite 2m 11s trunk passed
        +1 findbugs 3m 57s trunk passed
        +1 javadoc 1m 8s trunk passed
              Patch Compile Tests
        0 mvndep 0m 9s Maven dependency ordering for patch
        -1 mvninstall 0m 29s hadoop-hdfs-client in the patch failed.
        -1 mvninstall 0m 33s hadoop-hdfs in the patch failed.
        -1 compile 0m 30s hadoop-hdfs-project in the patch failed.
        -1 cc 0m 30s hadoop-hdfs-project in the patch failed.
        -1 javac 0m 30s hadoop-hdfs-project in the patch failed.
        +1 checkstyle 0m 51s the patch passed
        -1 mvnsite 0m 32s hadoop-hdfs-client in the patch failed.
        -1 mvnsite 0m 37s hadoop-hdfs in the patch failed.
        +1 whitespace 0m 0s The patch has no whitespace issues.
        -1 findbugs 0m 35s hadoop-hdfs-client in the patch failed.
        -1 findbugs 0m 39s hadoop-hdfs in the patch failed.
        -1 javadoc 0m 26s hadoop-hdfs-project_hadoop-hdfs-client generated 12 new + 1 unchanged - 0 fixed = 13 total (was 1)
        -1 javadoc 0m 50s hadoop-hdfs-project_hadoop-hdfs generated 6 new + 9 unchanged - 0 fixed = 15 total (was 9)
              Other Tests
        -1 unit 0m 34s hadoop-hdfs-client in the patch failed.
        -1 unit 0m 35s hadoop-hdfs in the patch failed.
        +1 asflicense 0m 18s The patch does not generate ASF License warnings.
        34m 47s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:71bbb86
        JIRA Issue HDFS-12447
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887306/HDFS-12447.002.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc
        uname Linux 8fbf7adf7096 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 50764ef
        Default Java 1.8.0_144
        findbugs v3.1.0-RC1
        mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs-client.txt
        mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs.txt
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-compile-hadoop-hdfs-project.txt
        cc https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-compile-hadoop-hdfs-project.txt
        javac https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-compile-hadoop-hdfs-project.txt
        mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-mvnsite-hadoop-hdfs-project_hadoop-hdfs-client.txt
        mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt
        findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-findbugs-hadoop-hdfs-project_hadoop-hdfs-client.txt
        findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt
        javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/diff-javadoc-javadoc-hadoop-hdfs-project_hadoop-hdfs-client.txt
        javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/diff-javadoc-javadoc-hadoop-hdfs-project_hadoop-hdfs.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-client.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/21157/testReport/
        modules C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/21157/console
        Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 25s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 5 new or modified test files.       trunk Compile Tests 0 mvndep 0m 25s Maven dependency ordering for branch +1 mvninstall 14m 14s trunk passed +1 compile 2m 3s trunk passed +1 checkstyle 1m 0s trunk passed +1 mvnsite 2m 11s trunk passed +1 findbugs 3m 57s trunk passed +1 javadoc 1m 8s trunk passed       Patch Compile Tests 0 mvndep 0m 9s Maven dependency ordering for patch -1 mvninstall 0m 29s hadoop-hdfs-client in the patch failed. -1 mvninstall 0m 33s hadoop-hdfs in the patch failed. -1 compile 0m 30s hadoop-hdfs-project in the patch failed. -1 cc 0m 30s hadoop-hdfs-project in the patch failed. -1 javac 0m 30s hadoop-hdfs-project in the patch failed. +1 checkstyle 0m 51s the patch passed -1 mvnsite 0m 32s hadoop-hdfs-client in the patch failed. -1 mvnsite 0m 37s hadoop-hdfs in the patch failed. +1 whitespace 0m 0s The patch has no whitespace issues. -1 findbugs 0m 35s hadoop-hdfs-client in the patch failed. -1 findbugs 0m 39s hadoop-hdfs in the patch failed. -1 javadoc 0m 26s hadoop-hdfs-project_hadoop-hdfs-client generated 12 new + 1 unchanged - 0 fixed = 13 total (was 1) -1 javadoc 0m 50s hadoop-hdfs-project_hadoop-hdfs generated 6 new + 9 unchanged - 0 fixed = 15 total (was 9)       Other Tests -1 unit 0m 34s hadoop-hdfs-client in the patch failed. -1 unit 0m 35s hadoop-hdfs in the patch failed. +1 asflicense 0m 18s The patch does not generate ASF License warnings. 34m 47s Subsystem Report/Notes Docker Image:yetus/hadoop:71bbb86 JIRA Issue HDFS-12447 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887306/HDFS-12447.002.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc uname Linux 8fbf7adf7096 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 50764ef Default Java 1.8.0_144 findbugs v3.1.0-RC1 mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs-client.txt mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs.txt compile https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-compile-hadoop-hdfs-project.txt cc https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-compile-hadoop-hdfs-project.txt javac https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-compile-hadoop-hdfs-project.txt mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-mvnsite-hadoop-hdfs-project_hadoop-hdfs-client.txt mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-findbugs-hadoop-hdfs-project_hadoop-hdfs-client.txt findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/diff-javadoc-javadoc-hadoop-hdfs-project_hadoop-hdfs-client.txt javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/diff-javadoc-javadoc-hadoop-hdfs-project_hadoop-hdfs.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-client.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/21157/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/21157/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project Console output https://builds.apache.org/job/PreCommit-HDFS-Build/21157/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        drankye Kai Zheng added a comment -

        Looks like the patch missed the new file AddErasureCodingPolicyResponse.java. Uploaded a new patch fixing the issue.

        Show
        drankye Kai Zheng added a comment - Looks like the patch missed the new file AddErasureCodingPolicyResponse.java . Uploaded a new patch fixing the issue.
        Hide
        drankye Kai Zheng added a comment -

        Andrew Wang could you give this a review? Hope to make this in as it affects API.

        Show
        drankye Kai Zheng added a comment - Andrew Wang could you give this a review? Hope to make this in as it affects API.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 28s Docker mode activated.
              Prechecks
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 5 new or modified test files.
              trunk Compile Tests
        0 mvndep 0m 40s Maven dependency ordering for branch
        +1 mvninstall 30m 9s trunk passed
        +1 compile 3m 36s trunk passed
        +1 checkstyle 1m 29s trunk passed
        +1 mvnsite 3m 26s trunk passed
        +1 findbugs 5m 44s trunk passed
        +1 javadoc 2m 14s trunk passed
              Patch Compile Tests
        0 mvndep 0m 19s Maven dependency ordering for patch
        +1 mvninstall 3m 11s the patch passed
        +1 compile 3m 25s the patch passed
        +1 cc 3m 25s the patch passed
        +1 javac 3m 25s the patch passed
        +1 checkstyle 1m 29s the patch passed
        +1 mvnsite 3m 15s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 6m 21s the patch passed
        +1 javadoc 2m 0s the patch passed
              Other Tests
        +1 unit 2m 21s hadoop-hdfs-client in the patch passed.
        -1 unit 187m 28s hadoop-hdfs in the patch failed.
        +1 asflicense 1m 20s The patch does not generate ASF License warnings.
        262m 28s



        Reason Tests
        Failed junit tests hadoop.hdfs.TestDFSStripedOutputStreamWithFailure110
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure180
          hadoop.hdfs.server.datanode.TestDirectoryScanner
          hadoop.hdfs.server.namenode.TestFsck
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure140
          hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure000
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure100
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure060
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure090
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure210
          hadoop.hdfs.TestReadStripedFileWithMissingBlocks
          hadoop.hdfs.server.namenode.TestDecommissioningStatus
          hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure010
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure130
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure200
          hadoop.hdfs.TestReconstructStripedFile
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure170
          hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
          hadoop.hdfs.server.datanode.TestDataNodeUUID
          hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
          hadoop.hdfs.security.TestDelegationTokenForProxyUser
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure050
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure040
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure190
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure020
          hadoop.hdfs.TestLeaseRecoveryStriped
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure070
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure160
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure030
          hadoop.hdfs.TestHDFSFileSystemContract
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure120
          hadoop.hdfs.server.namenode.TestNamenodeRetryCache
          hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
          hadoop.hdfs.server.datanode.TestDataNodeErasureCodingMetrics
        Timed out junit tests org.apache.hadoop.hdfs.TestReadStripedFileWithDecodingCorruptData
          org.apache.hadoop.hdfs.TestWriteReadStripedFile
          org.apache.hadoop.hdfs.TestReadStripedFileWithDecodingDeletedData



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:71bbb86
        JIRA Issue HDFS-12447
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887329/HDFS-12447.003.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc
        uname Linux ce3321fc9f00 3.13.0-129-generic #178-Ubuntu SMP Fri Aug 11 12:48:20 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 08b9814
        Default Java 1.8.0_144
        findbugs v3.1.0-RC1
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/21159/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/21159/testReport/
        modules C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/21159/console
        Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 28s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 5 new or modified test files.       trunk Compile Tests 0 mvndep 0m 40s Maven dependency ordering for branch +1 mvninstall 30m 9s trunk passed +1 compile 3m 36s trunk passed +1 checkstyle 1m 29s trunk passed +1 mvnsite 3m 26s trunk passed +1 findbugs 5m 44s trunk passed +1 javadoc 2m 14s trunk passed       Patch Compile Tests 0 mvndep 0m 19s Maven dependency ordering for patch +1 mvninstall 3m 11s the patch passed +1 compile 3m 25s the patch passed +1 cc 3m 25s the patch passed +1 javac 3m 25s the patch passed +1 checkstyle 1m 29s the patch passed +1 mvnsite 3m 15s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 6m 21s the patch passed +1 javadoc 2m 0s the patch passed       Other Tests +1 unit 2m 21s hadoop-hdfs-client in the patch passed. -1 unit 187m 28s hadoop-hdfs in the patch failed. +1 asflicense 1m 20s The patch does not generate ASF License warnings. 262m 28s Reason Tests Failed junit tests hadoop.hdfs.TestDFSStripedOutputStreamWithFailure110   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure180   hadoop.hdfs.server.datanode.TestDirectoryScanner   hadoop.hdfs.server.namenode.TestFsck   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure140   hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure000   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure100   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure060   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure090   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure210   hadoop.hdfs.TestReadStripedFileWithMissingBlocks   hadoop.hdfs.server.namenode.TestDecommissioningStatus   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure010   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure130   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure200   hadoop.hdfs.TestReconstructStripedFile   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure170   hadoop.hdfs.server.namenode.ha.TestPipelinesFailover   hadoop.hdfs.server.datanode.TestDataNodeUUID   hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics   hadoop.hdfs.security.TestDelegationTokenForProxyUser   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure050   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure040   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure190   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure020   hadoop.hdfs.TestLeaseRecoveryStriped   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure070   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure160   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure030   hadoop.hdfs.TestHDFSFileSystemContract   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure120   hadoop.hdfs.server.namenode.TestNamenodeRetryCache   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure   hadoop.hdfs.server.datanode.TestDataNodeErasureCodingMetrics Timed out junit tests org.apache.hadoop.hdfs.TestReadStripedFileWithDecodingCorruptData   org.apache.hadoop.hdfs.TestWriteReadStripedFile   org.apache.hadoop.hdfs.TestReadStripedFileWithDecodingDeletedData Subsystem Report/Notes Docker Image:yetus/hadoop:71bbb86 JIRA Issue HDFS-12447 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887329/HDFS-12447.003.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc uname Linux ce3321fc9f00 3.13.0-129-generic #178-Ubuntu SMP Fri Aug 11 12:48:20 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 08b9814 Default Java 1.8.0_144 findbugs v3.1.0-RC1 unit https://builds.apache.org/job/PreCommit-HDFS-Build/21159/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/21159/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project Console output https://builds.apache.org/job/PreCommit-HDFS-Build/21159/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 6m 29s Docker mode activated.
              Prechecks
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 5 new or modified test files.
              trunk Compile Tests
        0 mvndep 0m 9s Maven dependency ordering for branch
        +1 mvninstall 15m 48s trunk passed
        +1 compile 1m 52s trunk passed
        +1 checkstyle 0m 54s trunk passed
        +1 mvnsite 1m 50s trunk passed
        +1 findbugs 3m 44s trunk passed
        +1 javadoc 1m 12s trunk passed
              Patch Compile Tests
        0 mvndep 0m 8s Maven dependency ordering for patch
        +1 mvninstall 1m 44s the patch passed
        +1 compile 1m 45s the patch passed
        +1 cc 1m 45s the patch passed
        +1 javac 1m 45s the patch passed
        +1 checkstyle 0m 53s the patch passed
        +1 mvnsite 1m 42s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 3m 54s the patch passed
        +1 javadoc 0m 59s the patch passed
              Other Tests
        +1 unit 1m 13s hadoop-hdfs-client in the patch passed.
        -1 unit 84m 55s hadoop-hdfs in the patch failed.
        +1 asflicense 0m 18s The patch does not generate ASF License warnings.
        131m 1s



        Reason Tests
        Failed junit tests hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
          hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
          hadoop.hdfs.server.namenode.TestNamenodeRetryCache
          hadoop.hdfs.TestAppendDifferentChecksum
          hadoop.hdfs.TestFileAppend2
          hadoop.hdfs.TestLeaseRecoveryStriped
          hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery
        Timed out junit tests org.apache.hadoop.hdfs.TestWriteReadStripedFile



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:71bbb86
        JIRA Issue HDFS-12447
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887329/HDFS-12447.003.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc
        uname Linux bb0aa7ac6f5b 3.13.0-123-generic #172-Ubuntu SMP Mon Jun 26 18:04:35 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 3a8d57a
        Default Java 1.8.0_144
        findbugs v3.1.0-RC1
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/21170/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/21170/testReport/
        modules C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/21170/console
        Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 6m 29s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 5 new or modified test files.       trunk Compile Tests 0 mvndep 0m 9s Maven dependency ordering for branch +1 mvninstall 15m 48s trunk passed +1 compile 1m 52s trunk passed +1 checkstyle 0m 54s trunk passed +1 mvnsite 1m 50s trunk passed +1 findbugs 3m 44s trunk passed +1 javadoc 1m 12s trunk passed       Patch Compile Tests 0 mvndep 0m 8s Maven dependency ordering for patch +1 mvninstall 1m 44s the patch passed +1 compile 1m 45s the patch passed +1 cc 1m 45s the patch passed +1 javac 1m 45s the patch passed +1 checkstyle 0m 53s the patch passed +1 mvnsite 1m 42s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 3m 54s the patch passed +1 javadoc 0m 59s the patch passed       Other Tests +1 unit 1m 13s hadoop-hdfs-client in the patch passed. -1 unit 84m 55s hadoop-hdfs in the patch failed. +1 asflicense 0m 18s The patch does not generate ASF License warnings. 131m 1s Reason Tests Failed junit tests hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics   hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA   hadoop.hdfs.server.namenode.TestNamenodeRetryCache   hadoop.hdfs.TestAppendDifferentChecksum   hadoop.hdfs.TestFileAppend2   hadoop.hdfs.TestLeaseRecoveryStriped   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery Timed out junit tests org.apache.hadoop.hdfs.TestWriteReadStripedFile Subsystem Report/Notes Docker Image:yetus/hadoop:71bbb86 JIRA Issue HDFS-12447 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887329/HDFS-12447.003.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc uname Linux bb0aa7ac6f5b 3.13.0-123-generic #172-Ubuntu SMP Mon Jun 26 18:04:35 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 3a8d57a Default Java 1.8.0_144 findbugs v3.1.0-RC1 unit https://builds.apache.org/job/PreCommit-HDFS-Build/21170/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/21170/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project Console output https://builds.apache.org/job/PreCommit-HDFS-Build/21170/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        Sammi SammiChen added a comment -

        Rebase the patch against trunk.

        Show
        Sammi SammiChen added a comment - Rebase the patch against trunk.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 17s Docker mode activated.
              Prechecks
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 5 new or modified test files.
              trunk Compile Tests
        0 mvndep 0m 12s Maven dependency ordering for branch
        -1 mvninstall 15m 44s root in trunk failed.
        +1 compile 1m 44s trunk passed
        +1 checkstyle 0m 56s trunk passed
        +1 mvnsite 1m 52s trunk passed
        +1 findbugs 3m 50s trunk passed
        +1 javadoc 1m 7s trunk passed
              Patch Compile Tests
        0 mvndep 0m 9s Maven dependency ordering for patch
        +1 mvninstall 1m 28s the patch passed
        +1 compile 1m 54s the patch passed
        +1 cc 1m 54s the patch passed
        +1 javac 1m 54s the patch passed
        +1 checkstyle 0m 48s the patch passed
        +1 mvnsite 1m 31s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 3m 17s the patch passed
        +1 javadoc 0m 59s the patch passed
              Other Tests
        +1 unit 1m 13s hadoop-hdfs-client in the patch passed.
        -1 unit 96m 54s hadoop-hdfs in the patch failed.
        +1 asflicense 0m 18s The patch does not generate ASF License warnings.
        135m 47s



        Reason Tests
        Failed junit tests hadoop.hdfs.TestReadWhileWriting
          hadoop.hdfs.TestReadStripedFileWithMissingBlocks
          hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
          hadoop.hdfs.TestBalancerBandwidth
          hadoop.hdfs.server.namenode.TestReencryptionWithKMS
          hadoop.hdfs.server.namenode.TestDecommissioningStatus
          hadoop.hdfs.TestLeaseRecoveryStriped
          hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting
          hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
        Timed out junit tests org.apache.hadoop.hdfs.TestWriteReadStripedFile



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:71bbb86
        JIRA Issue HDFS-12447
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887843/HDFS-12447.004.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc
        uname Linux ca5115069f32 3.13.0-123-generic #172-Ubuntu SMP Mon Jun 26 18:04:35 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 2018538
        Default Java 1.8.0_144
        mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/21208/artifact/patchprocess/branch-mvninstall-root.txt
        findbugs v3.1.0-RC1
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/21208/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/21208/testReport/
        modules C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/21208/console
        Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 17s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 5 new or modified test files.       trunk Compile Tests 0 mvndep 0m 12s Maven dependency ordering for branch -1 mvninstall 15m 44s root in trunk failed. +1 compile 1m 44s trunk passed +1 checkstyle 0m 56s trunk passed +1 mvnsite 1m 52s trunk passed +1 findbugs 3m 50s trunk passed +1 javadoc 1m 7s trunk passed       Patch Compile Tests 0 mvndep 0m 9s Maven dependency ordering for patch +1 mvninstall 1m 28s the patch passed +1 compile 1m 54s the patch passed +1 cc 1m 54s the patch passed +1 javac 1m 54s the patch passed +1 checkstyle 0m 48s the patch passed +1 mvnsite 1m 31s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 3m 17s the patch passed +1 javadoc 0m 59s the patch passed       Other Tests +1 unit 1m 13s hadoop-hdfs-client in the patch passed. -1 unit 96m 54s hadoop-hdfs in the patch failed. +1 asflicense 0m 18s The patch does not generate ASF License warnings. 135m 47s Reason Tests Failed junit tests hadoop.hdfs.TestReadWhileWriting   hadoop.hdfs.TestReadStripedFileWithMissingBlocks   hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics   hadoop.hdfs.TestBalancerBandwidth   hadoop.hdfs.server.namenode.TestReencryptionWithKMS   hadoop.hdfs.server.namenode.TestDecommissioningStatus   hadoop.hdfs.TestLeaseRecoveryStriped   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure Timed out junit tests org.apache.hadoop.hdfs.TestWriteReadStripedFile Subsystem Report/Notes Docker Image:yetus/hadoop:71bbb86 JIRA Issue HDFS-12447 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887843/HDFS-12447.004.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc uname Linux ca5115069f32 3.13.0-123-generic #172-Ubuntu SMP Mon Jun 26 18:04:35 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 2018538 Default Java 1.8.0_144 mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/21208/artifact/patchprocess/branch-mvninstall-root.txt findbugs v3.1.0-RC1 unit https://builds.apache.org/job/PreCommit-HDFS-Build/21208/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/21208/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project Console output https://builds.apache.org/job/PreCommit-HDFS-Build/21208/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        Sammi SammiChen added a comment -

        Build failed at step "Apache Hadoop Client Packaging Invariants" and "Apache Hadoop Client Packaging Invariants for Test". Not sure why these two module failed.

        [INFO] Apache Hadoop Scheduler Load Simulator ............. SUCCESS [ 6.028 s]
        [INFO] Apache Hadoop Azure Data Lake support .............. SUCCESS [ 4.058 s]
        [INFO] Apache Hadoop Tools Dist ........................... SUCCESS [ 1.229 s]
        [INFO] Apache Hadoop Tools ................................ SUCCESS [ 0.029 s]
        [INFO] Apache Hadoop Client API ........................... SUCCESS [01:59 min]
        [INFO] Apache Hadoop Client Runtime ....................... SUCCESS [01:50 min]
        [INFO] Apache Hadoop Client Packaging Invariants .......... FAILURE [ 1.081 s]
        [INFO] Apache Hadoop Client Test Minicluster .............. SUCCESS [02:24 min]
        [INFO] Apache Hadoop Client Packaging Invariants for Test . FAILURE [ 0.120 s]
        [INFO] Apache Hadoop Client Packaging Integration Tests ... SUCCESS [ 1.231 s]
        [INFO] Apache Hadoop Distribution ......................... SKIPPED
        [INFO] Apache Hadoop Client Modules ....................... SUCCESS [ 0.075 s]
        [INFO] Apache Hadoop Cloud Storage ........................ SUCCESS [ 1.091 s]
        [INFO] Apache Hadoop Cloud Storage Project ................ SUCCESS [ 0.044 s]
        [INFO] ------------------------------------------------------------------------
        [INFO] BUILD FAILURE
        [INFO] ------------------------------------------------------------------------
        [INFO] Total time: 15:37 min
        [INFO] Finished at: 2017-09-19T07:49:44+00:00
        [INFO] Final Memory: 121M/497M
        [INFO] ------------------------------------------------------------------------
        [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.3.1:exec (check-jar-contents) on project hadoop-client-check-invariants: Command execution failed. Process exited with an error: 1 (Exit value: 1) -> [Help 1]
        [ERROR] Failed to execute goal org.apache.maven.plugins:maven-enforcer-plugin:3.0.0-M1:enforce (enforce-banned-dependencies) on project hadoop-client-check-test-invariants: Some Enforcer rules have failed. Look above for specific messages explaining why the rule failed. -> [Help 1]
        [ERROR]
        [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
        [ERROR] Re-run Maven using the -X switch to enable full debug logging.
        [ERROR]
        [ERROR] For more information about the errors and possible solutions, please read the following articles:
        [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
        [ERROR]
        [ERROR] After correcting the problems, you can resume the build with the command
        [ERROR] mvn <goals> -rf :hadoop-client-check-invariants

        Show
        Sammi SammiChen added a comment - Build failed at step "Apache Hadoop Client Packaging Invariants" and "Apache Hadoop Client Packaging Invariants for Test". Not sure why these two module failed. [INFO] Apache Hadoop Scheduler Load Simulator ............. SUCCESS [ 6.028 s] [INFO] Apache Hadoop Azure Data Lake support .............. SUCCESS [ 4.058 s] [INFO] Apache Hadoop Tools Dist ........................... SUCCESS [ 1.229 s] [INFO] Apache Hadoop Tools ................................ SUCCESS [ 0.029 s] [INFO] Apache Hadoop Client API ........................... SUCCESS [01:59 min] [INFO] Apache Hadoop Client Runtime ....................... SUCCESS [01:50 min] [INFO] Apache Hadoop Client Packaging Invariants .......... FAILURE [ 1.081 s] [INFO] Apache Hadoop Client Test Minicluster .............. SUCCESS [02:24 min] [INFO] Apache Hadoop Client Packaging Invariants for Test . FAILURE [ 0.120 s] [INFO] Apache Hadoop Client Packaging Integration Tests ... SUCCESS [ 1.231 s] [INFO] Apache Hadoop Distribution ......................... SKIPPED [INFO] Apache Hadoop Client Modules ....................... SUCCESS [ 0.075 s] [INFO] Apache Hadoop Cloud Storage ........................ SUCCESS [ 1.091 s] [INFO] Apache Hadoop Cloud Storage Project ................ SUCCESS [ 0.044 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 15:37 min [INFO] Finished at: 2017-09-19T07:49:44+00:00 [INFO] Final Memory: 121M/497M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.3.1:exec (check-jar-contents) on project hadoop-client-check-invariants: Command execution failed. Process exited with an error: 1 (Exit value: 1) -> [Help 1] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-enforcer-plugin:3.0.0-M1:enforce (enforce-banned-dependencies) on project hadoop-client-check-test-invariants: Some Enforcer rules have failed. Look above for specific messages explaining why the rule failed. -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-client-check-invariants
        Hide
        andrew.wang Andrew Wang added a comment -

        I think the build failure is due to HADOOP-14771, which we just reverted.

        I'll retrigger, also going to review shortly.

        Show
        andrew.wang Andrew Wang added a comment - I think the build failure is due to HADOOP-14771 , which we just reverted. I'll retrigger, also going to review shortly.
        Hide
        andrew.wang Andrew Wang added a comment -

        Thanks for working on this Sammi! This looks good to me, pretty straightforward renaming. There's one nit around an import going across multiple lines in PBHelper, but I can fix that at commit time if the retriggered Jenkins comes back clean. Nice work here.

        Show
        andrew.wang Andrew Wang added a comment - Thanks for working on this Sammi! This looks good to me, pretty straightforward renaming. There's one nit around an import going across multiple lines in PBHelper, but I can fix that at commit time if the retriggered Jenkins comes back clean. Nice work here.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 17s Docker mode activated.
              Prechecks
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 5 new or modified test files.
              trunk Compile Tests
        0 mvndep 0m 26s Maven dependency ordering for branch
        +1 mvninstall 14m 33s trunk passed
        +1 compile 1m 20s trunk passed
        +1 checkstyle 0m 42s trunk passed
        +1 mvnsite 1m 22s trunk passed
        +1 findbugs 2m 57s trunk passed
        +1 javadoc 1m 1s trunk passed
              Patch Compile Tests
        0 mvndep 0m 6s Maven dependency ordering for patch
        +1 mvninstall 1m 14s the patch passed
        +1 compile 1m 20s the patch passed
        +1 cc 1m 20s the patch passed
        +1 javac 1m 20s the patch passed
        +1 checkstyle 0m 39s the patch passed
        +1 mvnsite 1m 17s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 3m 10s the patch passed
        +1 javadoc 0m 52s the patch passed
              Other Tests
        +1 unit 1m 17s hadoop-hdfs-client in the patch passed.
        -1 unit 85m 38s hadoop-hdfs in the patch failed.
        +1 asflicense 0m 14s The patch does not generate ASF License warnings.
        119m 47s



        Reason Tests
        Failed junit tests hadoop.hdfs.TestDFSStripedOutputStreamWithFailure
          hadoop.hdfs.server.namenode.TestReencryptionWithKMS
          hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
          hadoop.hdfs.web.TestWebHdfsTimeouts



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:71bbb86
        JIRA Issue HDFS-12447
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887843/HDFS-12447.004.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc
        uname Linux bc69ba9d8b9a 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 12d9d7b
        Default Java 1.8.0_144
        findbugs v3.1.0-RC1
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/21230/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/21230/testReport/
        modules C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/21230/console
        Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 17s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 5 new or modified test files.       trunk Compile Tests 0 mvndep 0m 26s Maven dependency ordering for branch +1 mvninstall 14m 33s trunk passed +1 compile 1m 20s trunk passed +1 checkstyle 0m 42s trunk passed +1 mvnsite 1m 22s trunk passed +1 findbugs 2m 57s trunk passed +1 javadoc 1m 1s trunk passed       Patch Compile Tests 0 mvndep 0m 6s Maven dependency ordering for patch +1 mvninstall 1m 14s the patch passed +1 compile 1m 20s the patch passed +1 cc 1m 20s the patch passed +1 javac 1m 20s the patch passed +1 checkstyle 0m 39s the patch passed +1 mvnsite 1m 17s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 3m 10s the patch passed +1 javadoc 0m 52s the patch passed       Other Tests +1 unit 1m 17s hadoop-hdfs-client in the patch passed. -1 unit 85m 38s hadoop-hdfs in the patch failed. +1 asflicense 0m 14s The patch does not generate ASF License warnings. 119m 47s Reason Tests Failed junit tests hadoop.hdfs.TestDFSStripedOutputStreamWithFailure   hadoop.hdfs.server.namenode.TestReencryptionWithKMS   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure   hadoop.hdfs.web.TestWebHdfsTimeouts Subsystem Report/Notes Docker Image:yetus/hadoop:71bbb86 JIRA Issue HDFS-12447 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887843/HDFS-12447.004.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc uname Linux bc69ba9d8b9a 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 12d9d7b Default Java 1.8.0_144 findbugs v3.1.0-RC1 unit https://builds.apache.org/job/PreCommit-HDFS-Build/21230/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/21230/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project Console output https://builds.apache.org/job/PreCommit-HDFS-Build/21230/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        andrew.wang Andrew Wang added a comment -

        Thanks for the contribution Sammi, committed to trunk and branch-3.0.

        Show
        andrew.wang Andrew Wang added a comment - Thanks for the contribution Sammi, committed to trunk and branch-3.0.
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12928 (See https://builds.apache.org/job/Hadoop-trunk-Commit/12928/)
        HDFS-12447. Rename AddECPolicyResponse to (wang: rev a12f09ba3c4a3aa4c4558090c5e1b7bcaebe3b94)

        • (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/protocol/ClientProtocol.java
        • (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSImage.java
        • (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRpcServer.java
        • (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java
        • (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestErasureCodingPolicies.java
        • (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
        • (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
        • (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/ECAdmin.java
        • (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/ClientNamenodeProtocolServerSideTranslatorPB.java
        • (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsAdmin.java
        • (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelperClient.java
        • (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/proto/hdfs.proto
        • (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
        • (delete) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/protocol/AddECPolicyResponse.java
        • (add) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/protocol/AddErasureCodingPolicyResponse.java
        • (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/protocolPB/ClientNamenodeProtocolTranslatorPB.java
        • (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/proto/erasurecoding.proto
        • (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/protocolPB/TestPBHelper.java
        • (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12928 (See https://builds.apache.org/job/Hadoop-trunk-Commit/12928/ ) HDFS-12447 . Rename AddECPolicyResponse to (wang: rev a12f09ba3c4a3aa4c4558090c5e1b7bcaebe3b94) (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/protocol/ClientProtocol.java (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSImage.java (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRpcServer.java (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestErasureCodingPolicies.java (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/ECAdmin.java (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/ClientNamenodeProtocolServerSideTranslatorPB.java (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsAdmin.java (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelperClient.java (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/proto/hdfs.proto (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java (delete) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/protocol/AddECPolicyResponse.java (add) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/protocol/AddErasureCodingPolicyResponse.java (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/protocolPB/ClientNamenodeProtocolTranslatorPB.java (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/proto/erasurecoding.proto (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/protocolPB/TestPBHelper.java (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13045 (See https://builds.apache.org/job/Hadoop-trunk-Commit/13045/)
        HDFS-12580. Rebasing HDFS-10467 after HDFS-12447. Contributed by Inigo (inigoiri: rev 6c69e23dcdf1cdbddd47bacdf2dace5c9f06e3ad)

        • (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterRpcServer.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13045 (See https://builds.apache.org/job/Hadoop-trunk-Commit/13045/ ) HDFS-12580 . Rebasing HDFS-10467 after HDFS-12447 . Contributed by Inigo (inigoiri: rev 6c69e23dcdf1cdbddd47bacdf2dace5c9f06e3ad) (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterRpcServer.java

          People

          • Assignee:
            Sammi SammiChen
            Reporter:
            Sammi SammiChen
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development