Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13584

hadoop-aliyun: merge HADOOP-12756 branch back

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0-alpha2
    • Component/s: fs
    • Labels:
      None

      Description

      We have finished a round of improvement over Hadoop-12756 branch, which intends to incorporate Aliyun OSS support in Hadoop. This feature provides basic support for data access to Aliyun OSS from Hadoop applications.

      In the implementation, we follow the style of S3 support in Hadooop. Besides we also provide FileSystem contract test over real Aliyun OSS environment. By simple configuration, it can be enabled/disabled.

      1. HADOOP-13584.001.patch
        135 kB
        shimingfei
      2. HADOOP-13584.002.patch
        138 kB
        Genmao Yu
      3. HADOOP-13584.003.patch
        138 kB
        Genmao Yu
      4. HADOOP-13584.004.patch
        138 kB
        Genmao Yu
      5. HADOOP-13584.005.patch
        139 kB
        Genmao Yu

        Activity

        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 18s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 19 new or modified test files.
        0 mvndep 1m 26s Maven dependency ordering for branch
        +1 mvninstall 6m 47s trunk passed
        +1 compile 6m 51s trunk passed
        +1 checkstyle 1m 23s trunk passed
        +1 mvnsite 9m 20s trunk passed
        +1 mvneclipse 1m 0s trunk passed
        0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project hadoop-tools/hadoop-tools-dist hadoop-tools .
        +1 findbugs 0m 0s trunk passed
        +1 javadoc 4m 42s trunk passed
        0 mvndep 0m 21s Maven dependency ordering for patch
        +1 mvninstall 8m 44s the patch passed
        +1 compile 6m 55s the patch passed
        +1 javac 6m 55s the patch passed
        +1 checkstyle 1m 29s the patch passed
        +1 mvnsite 9m 25s the patch passed
        +1 mvneclipse 1m 5s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 xml 0m 9s The patch has no ill-formed XML file.
        0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project . hadoop-tools hadoop-tools/hadoop-tools-dist
        +1 findbugs 0m 37s the patch passed
        +1 javadoc 4m 45s the patch passed
        -1 unit 98m 17s root in the patch failed.
        -1 asflicense 0m 30s The patch generated 2 ASF License warnings.
        186m 13s



        Reason Tests
        Failed junit tests hadoop.hdfs.tools.TestDFSZKFailoverController
          hadoop.hdfs.server.datanode.TestDataNodeUUID
          hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA
          hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Issue HADOOP-13584
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12827304/HADOOP-13584.001.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml findbugs checkstyle
        uname Linux ac852d56797d 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 680be58
        Default Java 1.8.0_101
        unit https://builds.apache.org/job/PreCommit-HADOOP-Build/10455/artifact/patchprocess/patch-unit-root.txt
        Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10455/testReport/
        asflicense https://builds.apache.org/job/PreCommit-HADOOP-Build/10455/artifact/patchprocess/patch-asflicense-problems.txt
        modules C: hadoop-project hadoop-tools/hadoop-aliyun . hadoop-tools hadoop-tools/hadoop-tools-dist U: .
        Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10455/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 18s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 19 new or modified test files. 0 mvndep 1m 26s Maven dependency ordering for branch +1 mvninstall 6m 47s trunk passed +1 compile 6m 51s trunk passed +1 checkstyle 1m 23s trunk passed +1 mvnsite 9m 20s trunk passed +1 mvneclipse 1m 0s trunk passed 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project hadoop-tools/hadoop-tools-dist hadoop-tools . +1 findbugs 0m 0s trunk passed +1 javadoc 4m 42s trunk passed 0 mvndep 0m 21s Maven dependency ordering for patch +1 mvninstall 8m 44s the patch passed +1 compile 6m 55s the patch passed +1 javac 6m 55s the patch passed +1 checkstyle 1m 29s the patch passed +1 mvnsite 9m 25s the patch passed +1 mvneclipse 1m 5s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 9s The patch has no ill-formed XML file. 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project . hadoop-tools hadoop-tools/hadoop-tools-dist +1 findbugs 0m 37s the patch passed +1 javadoc 4m 45s the patch passed -1 unit 98m 17s root in the patch failed. -1 asflicense 0m 30s The patch generated 2 ASF License warnings. 186m 13s Reason Tests Failed junit tests hadoop.hdfs.tools.TestDFSZKFailoverController   hadoop.hdfs.server.datanode.TestDataNodeUUID   hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA   hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue HADOOP-13584 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12827304/HADOOP-13584.001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml findbugs checkstyle uname Linux ac852d56797d 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 680be58 Default Java 1.8.0_101 unit https://builds.apache.org/job/PreCommit-HADOOP-Build/10455/artifact/patchprocess/patch-unit-root.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10455/testReport/ asflicense https://builds.apache.org/job/PreCommit-HADOOP-Build/10455/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-project hadoop-tools/hadoop-aliyun . hadoop-tools hadoop-tools/hadoop-tools-dist U: . Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10455/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 15s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 19 new or modified test files.
        0 mvndep 0m 17s Maven dependency ordering for branch
        +1 mvninstall 7m 43s trunk passed
        +1 compile 7m 44s trunk passed
        +1 checkstyle 1m 32s trunk passed
        +1 mvnsite 10m 22s trunk passed
        +1 mvneclipse 3m 30s trunk passed
        0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project hadoop-tools/hadoop-tools-dist hadoop-tools .
        +1 findbugs 0m 0s trunk passed
        +1 javadoc 5m 9s trunk passed
        0 mvndep 0m 20s Maven dependency ordering for patch
        +1 mvninstall 9m 40s the patch passed
        +1 compile 7m 44s the patch passed
        +1 javac 7m 44s the patch passed
        +1 checkstyle 1m 35s the patch passed
        +1 mvnsite 10m 18s the patch passed
        +1 mvneclipse 1m 20s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 xml 0m 9s The patch has no ill-formed XML file.
        0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project . hadoop-tools hadoop-tools/hadoop-tools-dist
        +1 findbugs 0m 38s the patch passed
        +1 javadoc 5m 14s the patch passed
        -1 unit 97m 9s root in the patch failed.
        -1 asflicense 0m 33s The patch generated 2 ASF License warnings.
        192m 48s



        Reason Tests
        Failed junit tests hadoop.hdfs.TestErasureCodeBenchmarkThroughput
          hadoop.hdfs.TestDFSShell
          hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager
          hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Issue HADOOP-13584
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12829157/HADOOP-13584.002.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml findbugs checkstyle
        uname Linux 6b5a59340513 3.13.0-93-generic #140-Ubuntu SMP Mon Jul 18 21:21:05 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 3552c2b
        Default Java 1.8.0_101
        unit https://builds.apache.org/job/PreCommit-HADOOP-Build/10540/artifact/patchprocess/patch-unit-root.txt
        Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10540/testReport/
        asflicense https://builds.apache.org/job/PreCommit-HADOOP-Build/10540/artifact/patchprocess/patch-asflicense-problems.txt
        modules C: hadoop-project hadoop-tools/hadoop-aliyun . hadoop-tools hadoop-tools/hadoop-tools-dist U: .
        Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10540/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 15s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 19 new or modified test files. 0 mvndep 0m 17s Maven dependency ordering for branch +1 mvninstall 7m 43s trunk passed +1 compile 7m 44s trunk passed +1 checkstyle 1m 32s trunk passed +1 mvnsite 10m 22s trunk passed +1 mvneclipse 3m 30s trunk passed 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project hadoop-tools/hadoop-tools-dist hadoop-tools . +1 findbugs 0m 0s trunk passed +1 javadoc 5m 9s trunk passed 0 mvndep 0m 20s Maven dependency ordering for patch +1 mvninstall 9m 40s the patch passed +1 compile 7m 44s the patch passed +1 javac 7m 44s the patch passed +1 checkstyle 1m 35s the patch passed +1 mvnsite 10m 18s the patch passed +1 mvneclipse 1m 20s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 9s The patch has no ill-formed XML file. 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project . hadoop-tools hadoop-tools/hadoop-tools-dist +1 findbugs 0m 38s the patch passed +1 javadoc 5m 14s the patch passed -1 unit 97m 9s root in the patch failed. -1 asflicense 0m 33s The patch generated 2 ASF License warnings. 192m 48s Reason Tests Failed junit tests hadoop.hdfs.TestErasureCodeBenchmarkThroughput   hadoop.hdfs.TestDFSShell   hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager   hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue HADOOP-13584 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12829157/HADOOP-13584.002.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml findbugs checkstyle uname Linux 6b5a59340513 3.13.0-93-generic #140-Ubuntu SMP Mon Jul 18 21:21:05 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 3552c2b Default Java 1.8.0_101 unit https://builds.apache.org/job/PreCommit-HADOOP-Build/10540/artifact/patchprocess/patch-unit-root.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10540/testReport/ asflicense https://builds.apache.org/job/PreCommit-HADOOP-Build/10540/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-project hadoop-tools/hadoop-aliyun . hadoop-tools hadoop-tools/hadoop-tools-dist U: . Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10540/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        uncleGen Genmao Yu added a comment - - edited

        Kai Zheng Ready for your review. There are some errors, but seems to has no relationship with my patch.

         Reason | Tests
         Failed junit tests  |  hadoop.hdfs.TestErasureCodeBenchmarkThroughput 
                             |  hadoop.hdfs.TestDFSShell 
                             |  hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager 
                             |  hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices
        
        
        Lines that start with ????? in the ASF License  report indicate files that do not have an Apache license header:
         !????? /testptch/hadoop/hadoop-build-tools/.externalToolBuilders/Maven_Ant_Builder.launch
         !????? /testptch/hadoop/hadoop-build-tools/maven-eclipse.xml
        

        unit test results:

        [INFO] Scanning for projects...
        [INFO]                                                                         
        [INFO] ------------------------------------------------------------------------
        [INFO] Building Apache Hadoop Aliyun OSS support 3.0.0-alpha2-SNAPSHOT
        [INFO] ------------------------------------------------------------------------
        [INFO] 
        [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-aliyun ---
        [INFO] Deleting /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target
        [INFO] 
        [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-aliyun ---
        [INFO] Executing tasks
        
        main:
            [mkdir] Created dir: /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target/test-dir
        [INFO] Executed tasks
        [INFO] 
        [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hadoop-aliyun ---
        [INFO] 
        [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hadoop-aliyun ---
        [INFO] Using 'UTF-8' encoding to copy filtered resources.
        [INFO] skip non existing resourceDirectory /develop/github/hadoop/hadoop-tools/hadoop-aliyun/src/main/resources
        [INFO] Copying 2 resources
        [INFO] 
        [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hadoop-aliyun ---
        [INFO] Compiling 8 source files to /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target/classes
        [INFO] 
        [INFO] --- maven-dependency-plugin:2.2:list (deplist) @ hadoop-aliyun ---
        [INFO] 
        [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hadoop-aliyun ---
        [INFO] Using 'UTF-8' encoding to copy filtered resources.
        [INFO] Copying 5 resources
        [INFO] Copying 2 resources
        [INFO] 
        [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hadoop-aliyun ---
        [INFO] Compiling 16 source files to /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target/test-classes
        [INFO] 
        [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ hadoop-aliyun ---
        [INFO] Surefire report directory: /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target/surefire-reports
        
        -------------------------------------------------------
         T E S T S
        -------------------------------------------------------
        
        -------------------------------------------------------
         T E S T S
        -------------------------------------------------------
        Running org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSFileSystemStore
        Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.056 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSFileSystemStore
        Running org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSInputStream
        Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.429 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSInputStream
        Running org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSFileSystemContract
        Tests run: 46, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.207 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSFileSystemContract
        Running org.apache.hadoop.fs.aliyun.oss.TestAliyunCredentials
        Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.276 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunCredentials
        Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractRootDir
        Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.656 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractRootDir
        Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractRename
        Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.229 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractRename
        Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractCreate
        Tests run: 6, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 4.53 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractCreate
        Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractMkdir
        Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.17 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractMkdir
        Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractDelete
        Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.672 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractDelete
        Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractGetFileStatus
        Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.836 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractGetFileStatus
        Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractOpen
        Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.748 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractOpen
        Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractDispCp
        Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.605 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractDispCp
        Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractSeek
        Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.058 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractSeek
        Running org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSOutputStream
        Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.004 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSOutputStream
        
        Results :
        
        Tests run: 133, Failures: 0, Errors: 0, Skipped: 1
        
        [INFO] ------------------------------------------------------------------------
        [INFO] BUILD SUCCESS
        [INFO] ------------------------------------------------------------------------
        [INFO] Total time: 03:06 min
        [INFO] Finished at: 2016-09-19T19:25:43+08:00
        [INFO] Final Memory: 45M/733M
        [INFO] ------------------------------------------------------------------------
        
        Show
        uncleGen Genmao Yu added a comment - - edited Kai Zheng Ready for your review. There are some errors, but seems to has no relationship with my patch. Reason | Tests Failed junit tests | hadoop.hdfs.TestErasureCodeBenchmarkThroughput | hadoop.hdfs.TestDFSShell | hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager | hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices Lines that start with ????? in the ASF License report indicate files that do not have an Apache license header: !????? /testptch/hadoop/hadoop-build-tools/.externalToolBuilders/Maven_Ant_Builder.launch !????? /testptch/hadoop/hadoop-build-tools/maven-eclipse.xml unit test results: [INFO] Scanning for projects... [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop Aliyun OSS support 3.0.0-alpha2-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean ( default -clean) @ hadoop-aliyun --- [INFO] Deleting /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-aliyun --- [INFO] Executing tasks main: [mkdir] Created dir: /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target/test-dir [INFO] Executed tasks [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process ( default ) @ hadoop-aliyun --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources ( default -resources) @ hadoop-aliyun --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /develop/github/hadoop/hadoop-tools/hadoop-aliyun/src/main/resources [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile ( default -compile) @ hadoop-aliyun --- [INFO] Compiling 8 source files to /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target/classes [INFO] [INFO] --- maven-dependency-plugin:2.2:list (deplist) @ hadoop-aliyun --- [INFO] [INFO] --- maven-resources-plugin:2.6:testResources ( default -testResources) @ hadoop-aliyun --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 5 resources [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile ( default -testCompile) @ hadoop-aliyun --- [INFO] Compiling 16 source files to /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test ( default -test) @ hadoop-aliyun --- [INFO] Surefire report directory: /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target/surefire-reports ------------------------------------------------------- T E S T S ------------------------------------------------------- ------------------------------------------------------- T E S T S ------------------------------------------------------- Running org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSFileSystemStore Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.056 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSFileSystemStore Running org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSInputStream Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.429 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSInputStream Running org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSFileSystemContract Tests run: 46, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.207 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSFileSystemContract Running org.apache.hadoop.fs.aliyun.oss.TestAliyunCredentials Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.276 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunCredentials Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractRootDir Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.656 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractRootDir Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractRename Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.229 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractRename Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractCreate Tests run: 6, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 4.53 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractCreate Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractMkdir Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.17 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractMkdir Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractDelete Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.672 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractDelete Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractGetFileStatus Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.836 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractGetFileStatus Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractOpen Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.748 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractOpen Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractDispCp Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.605 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractDispCp Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractSeek Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.058 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractSeek Running org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSOutputStream Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.004 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSOutputStream Results : Tests run: 133, Failures: 0, Errors: 0, Skipped: 1 [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 03:06 min [INFO] Finished at: 2016-09-19T19:25:43+08:00 [INFO] Final Memory: 45M/733M [INFO] ------------------------------------------------------------------------
        Hide
        uncleGen Genmao Yu added a comment -
        Show
        uncleGen Genmao Yu added a comment - Kai Zheng add HADOOP-13624
        Hide
        uncleGen Genmao Yu added a comment -

        Kai Zheng rebase and add HADOOP-13634

        Show
        uncleGen Genmao Yu added a comment - Kai Zheng rebase and add HADOOP-13634
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 13s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 19 new or modified test files.
        0 mvndep 1m 40s Maven dependency ordering for branch
        +1 mvninstall 7m 33s trunk passed
        +1 compile 9m 41s trunk passed
        +1 checkstyle 1m 35s trunk passed
        +1 mvnsite 13m 6s trunk passed
        +1 mvneclipse 0m 56s trunk passed
        0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project hadoop-tools/hadoop-tools-dist hadoop-tools .
        +1 findbugs 0m 0s trunk passed
        +1 javadoc 4m 54s trunk passed
        0 mvndep 0m 17s Maven dependency ordering for patch
        +1 mvninstall 9m 26s the patch passed
        +1 compile 9m 39s the patch passed
        +1 javac 9m 39s the patch passed
        +1 checkstyle 1m 29s the patch passed
        +1 mvnsite 9m 37s the patch passed
        +1 mvneclipse 1m 1s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 xml 0m 7s The patch has no ill-formed XML file.
        0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project hadoop-tools/hadoop-tools-dist hadoop-tools .
        +1 findbugs 0m 37s the patch passed
        +1 javadoc 6m 4s the patch passed
        -1 unit 102m 2s root in the patch failed.
        -1 asflicense 0m 33s The patch generated 2 ASF License warnings.
        202m 7s



        Reason Tests
        Failed junit tests hadoop.hdfs.TestDFSShell
          hadoop.hdfs.server.datanode.TestDirectoryScanner
          hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Issue HADOOP-13584
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12829738/HADOOP-13584.004.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml findbugs checkstyle
        uname Linux c8094485cb19 3.13.0-93-generic #140-Ubuntu SMP Mon Jul 18 21:21:05 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 537095d
        Default Java 1.8.0_101
        unit https://builds.apache.org/job/PreCommit-HADOOP-Build/10565/artifact/patchprocess/patch-unit-root.txt
        Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10565/testReport/
        asflicense https://builds.apache.org/job/PreCommit-HADOOP-Build/10565/artifact/patchprocess/patch-asflicense-problems.txt
        modules C: hadoop-project hadoop-tools/hadoop-aliyun hadoop-tools/hadoop-tools-dist hadoop-tools . U: .
        Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10565/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 13s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 19 new or modified test files. 0 mvndep 1m 40s Maven dependency ordering for branch +1 mvninstall 7m 33s trunk passed +1 compile 9m 41s trunk passed +1 checkstyle 1m 35s trunk passed +1 mvnsite 13m 6s trunk passed +1 mvneclipse 0m 56s trunk passed 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project hadoop-tools/hadoop-tools-dist hadoop-tools . +1 findbugs 0m 0s trunk passed +1 javadoc 4m 54s trunk passed 0 mvndep 0m 17s Maven dependency ordering for patch +1 mvninstall 9m 26s the patch passed +1 compile 9m 39s the patch passed +1 javac 9m 39s the patch passed +1 checkstyle 1m 29s the patch passed +1 mvnsite 9m 37s the patch passed +1 mvneclipse 1m 1s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 7s The patch has no ill-formed XML file. 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project hadoop-tools/hadoop-tools-dist hadoop-tools . +1 findbugs 0m 37s the patch passed +1 javadoc 6m 4s the patch passed -1 unit 102m 2s root in the patch failed. -1 asflicense 0m 33s The patch generated 2 ASF License warnings. 202m 7s Reason Tests Failed junit tests hadoop.hdfs.TestDFSShell   hadoop.hdfs.server.datanode.TestDirectoryScanner   hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue HADOOP-13584 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12829738/HADOOP-13584.004.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml findbugs checkstyle uname Linux c8094485cb19 3.13.0-93-generic #140-Ubuntu SMP Mon Jul 18 21:21:05 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 537095d Default Java 1.8.0_101 unit https://builds.apache.org/job/PreCommit-HADOOP-Build/10565/artifact/patchprocess/patch-unit-root.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/10565/testReport/ asflicense https://builds.apache.org/job/PreCommit-HADOOP-Build/10565/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-project hadoop-tools/hadoop-aliyun hadoop-tools/hadoop-tools-dist hadoop-tools . U: . Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/10565/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        uncleGen Genmao Yu added a comment - - edited

        Unit test result for patch-v4:

        [INFO] Scanning for projects...
        [INFO]                                                                         
        [INFO] ------------------------------------------------------------------------
        [INFO] Building Apache Hadoop Aliyun OSS support 3.0.0-alpha2-SNAPSHOT
        [INFO] ------------------------------------------------------------------------
        [INFO] 
        [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-aliyun ---
        [INFO] Deleting /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target
        [INFO] 
        [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-aliyun ---
        [INFO] Executing tasks
        
        main:
            [mkdir] Created dir: /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target/test-dir
        [INFO] Executed tasks
        [INFO] 
        [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hadoop-aliyun ---
        [INFO] 
        [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hadoop-aliyun ---
        [INFO] Using 'UTF-8' encoding to copy filtered resources.
        [INFO] skip non existing resourceDirectory /develop/github/hadoop/hadoop-tools/hadoop-aliyun/src/main/resources
        [INFO] Copying 2 resources
        [INFO] 
        [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hadoop-aliyun ---
        [INFO] Compiling 8 source files to /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target/classes
        [INFO] 
        [INFO] --- maven-dependency-plugin:2.2:list (deplist) @ hadoop-aliyun ---
        [INFO] 
        [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hadoop-aliyun ---
        [INFO] Using 'UTF-8' encoding to copy filtered resources.
        [INFO] Copying 5 resources
        [INFO] Copying 2 resources
        [INFO] 
        [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hadoop-aliyun ---
        [INFO] Compiling 16 source files to /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target/test-classes
        [INFO] 
        [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ hadoop-aliyun ---
        [INFO] Surefire report directory: /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target/surefire-reports
        
        -------------------------------------------------------
         T E S T S
        -------------------------------------------------------
        
        -------------------------------------------------------
         T E S T S
        -------------------------------------------------------
        Running org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSFileSystemStore
        Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 54.363 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSFileSystemStore
        Running org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSInputStream
        Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.283 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSInputStream
        Running org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSFileSystemContract
        Tests run: 46, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.78 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSFileSystemContract
        Running org.apache.hadoop.fs.aliyun.oss.TestAliyunCredentials
        Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.824 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunCredentials
        Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractRootDir
        Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.018 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractRootDir
        Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractRename
        Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.695 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractRename
        Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractCreate
        Tests run: 6, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 3.473 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractCreate
        Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractMkdir
        Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.441 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractMkdir
        Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractDistCp
        Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.061 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractDistCp
        Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractDelete
        Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.426 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractDelete
        Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractGetFileStatus
        Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.133 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractGetFileStatus
        Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractOpen
        Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.916 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractOpen
        Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractSeek
        Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.198 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractSeek
        Running org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSOutputStream
        Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.357 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSOutputStream
        
        Results :
        
        Tests run: 133, Failures: 0, Errors: 0, Skipped: 1
        
        [INFO] ------------------------------------------------------------------------
        [INFO] BUILD SUCCESS
        [INFO] ------------------------------------------------------------------------
        [INFO] Total time: 03:06 min
        [INFO] Finished at: 2016-09-22T15:56:22+08:00
        [INFO] Final Memory: 43M/622M
        [INFO] ------------------------------------------------------------------------
        
        Show
        uncleGen Genmao Yu added a comment - - edited Unit test result for patch-v4: [INFO] Scanning for projects... [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop Aliyun OSS support 3.0.0-alpha2-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean ( default -clean) @ hadoop-aliyun --- [INFO] Deleting /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-aliyun --- [INFO] Executing tasks main: [mkdir] Created dir: /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target/test-dir [INFO] Executed tasks [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process ( default ) @ hadoop-aliyun --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources ( default -resources) @ hadoop-aliyun --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /develop/github/hadoop/hadoop-tools/hadoop-aliyun/src/main/resources [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile ( default -compile) @ hadoop-aliyun --- [INFO] Compiling 8 source files to /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target/classes [INFO] [INFO] --- maven-dependency-plugin:2.2:list (deplist) @ hadoop-aliyun --- [INFO] [INFO] --- maven-resources-plugin:2.6:testResources ( default -testResources) @ hadoop-aliyun --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 5 resources [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile ( default -testCompile) @ hadoop-aliyun --- [INFO] Compiling 16 source files to /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.17:test ( default -test) @ hadoop-aliyun --- [INFO] Surefire report directory: /develop/github/hadoop/hadoop-tools/hadoop-aliyun/target/surefire-reports ------------------------------------------------------- T E S T S ------------------------------------------------------- ------------------------------------------------------- T E S T S ------------------------------------------------------- Running org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSFileSystemStore Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 54.363 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSFileSystemStore Running org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSInputStream Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.283 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSInputStream Running org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSFileSystemContract Tests run: 46, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.78 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSFileSystemContract Running org.apache.hadoop.fs.aliyun.oss.TestAliyunCredentials Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.824 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunCredentials Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractRootDir Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.018 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractRootDir Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractRename Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.695 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractRename Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractCreate Tests run: 6, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 3.473 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractCreate Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractMkdir Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.441 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractMkdir Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractDistCp Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.061 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractDistCp Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractDelete Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.426 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractDelete Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractGetFileStatus Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.133 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractGetFileStatus Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractOpen Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.916 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractOpen Running org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractSeek Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.198 sec - in org.apache.hadoop.fs.aliyun.oss.contract.TestAliyunOSSContractSeek Running org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSOutputStream Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.357 sec - in org.apache.hadoop.fs.aliyun.oss.TestAliyunOSSOutputStream Results : Tests run: 133, Failures: 0, Errors: 0, Skipped: 1 [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 03:06 min [INFO] Finished at: 2016-09-22T15:56:22+08:00 [INFO] Final Memory: 43M/622M [INFO] ------------------------------------------------------------------------
        Hide
        drankye Kai Zheng added a comment -

        commit 5707f88d8550346f167e45c2f8c4161eb3957e3a
        Author: Kai Zheng <kai.zheng@intel.com>
        Date: Mon Sep 26 20:42:22 2016 +0800

        HADOOP-13584. hdoop-aliyun: merge HADOOP-12756 branch back.

        HADOOP-12756 branch: Incorporate Aliyun OSS file system implementation. Contributors:
        Mingfei Shi (mingfei.shi@intel.com)
        Genmao Yu (genmao.ygm@alibaba-inc.com)

        Show
        drankye Kai Zheng added a comment - commit 5707f88d8550346f167e45c2f8c4161eb3957e3a Author: Kai Zheng <kai.zheng@intel.com> Date: Mon Sep 26 20:42:22 2016 +0800 HADOOP-13584 . hdoop-aliyun: merge HADOOP-12756 branch back. HADOOP-12756 branch: Incorporate Aliyun OSS file system implementation. Contributors: Mingfei Shi (mingfei.shi@intel.com) Genmao Yu (genmao.ygm@alibaba-inc.com)
        Hide
        drankye Kai Zheng added a comment -

        Just committed it to trunk branch. We may also consider other branches later.

        Show
        drankye Kai Zheng added a comment - Just committed it to trunk branch. We may also consider other branches later.
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10485 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10485/)
        HADOOP-13584. hdoop-aliyun: merge HADOOP-12756 branch back. (kai.zheng: rev 5707f88d8550346f167e45c2f8c4161eb3957e3a)

        • (add) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSOutputStream.java
        • (add) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/Constants.java
        • (add) hadoop-tools/hadoop-aliyun/src/site/markdown/tools/hadoop-aliyun/index.md
        • (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractDistCp.java
        • (add) hadoop-tools/hadoop-aliyun/pom.xml
        • (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunOSSFileSystemStore.java
        • (add) hadoop-tools/hadoop-aliyun/dev-support/findbugs-exclude.xml
        • (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunOSSFileSystemContract.java
        • (add) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSInputStream.java
        • (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractGetFileStatus.java
        • (add) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunCredentialsProvider.java
        • (add) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/package-info.java
        • (add) hadoop-tools/hadoop-aliyun/src/test/resources/core-site.xml
        • (add) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSUtils.java
        • (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractOpen.java
        • (add) hadoop-tools/hadoop-aliyun/src/test/resources/contract/aliyun-oss.xml
        • (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractMkdir.java
        • (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractRootDir.java
        • (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractSeek.java
        • (add) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSFileSystemStore.java
        • (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunOSSOutputStream.java
        • (edit) hadoop-project/pom.xml
        • (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractDelete.java
        • (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractCreate.java
        • (add) hadoop-tools/hadoop-aliyun/src/test/resources/log4j.properties
        • (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractRename.java
        • (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunCredentials.java
        • (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunOSSInputStream.java
        • (edit) hadoop-tools/hadoop-tools-dist/pom.xml
        • (edit) .gitignore
        • (add) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSFileSystem.java
        • (edit) hadoop-tools/pom.xml
        • (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/AliyunOSSContract.java
        • (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSTestUtils.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10485 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10485/ ) HADOOP-13584 . hdoop-aliyun: merge HADOOP-12756 branch back. (kai.zheng: rev 5707f88d8550346f167e45c2f8c4161eb3957e3a) (add) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSOutputStream.java (add) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/Constants.java (add) hadoop-tools/hadoop-aliyun/src/site/markdown/tools/hadoop-aliyun/index.md (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractDistCp.java (add) hadoop-tools/hadoop-aliyun/pom.xml (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunOSSFileSystemStore.java (add) hadoop-tools/hadoop-aliyun/dev-support/findbugs-exclude.xml (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunOSSFileSystemContract.java (add) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSInputStream.java (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractGetFileStatus.java (add) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunCredentialsProvider.java (add) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/package-info.java (add) hadoop-tools/hadoop-aliyun/src/test/resources/core-site.xml (add) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSUtils.java (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractOpen.java (add) hadoop-tools/hadoop-aliyun/src/test/resources/contract/aliyun-oss.xml (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractMkdir.java (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractRootDir.java (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractSeek.java (add) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSFileSystemStore.java (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunOSSOutputStream.java (edit) hadoop-project/pom.xml (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractDelete.java (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractCreate.java (add) hadoop-tools/hadoop-aliyun/src/test/resources/log4j.properties (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractRename.java (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunCredentials.java (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunOSSInputStream.java (edit) hadoop-tools/hadoop-tools-dist/pom.xml (edit) .gitignore (add) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSFileSystem.java (edit) hadoop-tools/pom.xml (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/AliyunOSSContract.java (add) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSTestUtils.java
        Hide
        drankye Kai Zheng added a comment -

        This was reverted according to the latest discussion in HADOOP-12756.

        Show
        drankye Kai Zheng added a comment - This was reverted according to the latest discussion in HADOOP-12756 .
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10502 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10502/)
        Revert "HADOOP-13584. hdoop-aliyun: merge HADOOP-12756 branch back" This (kai.zheng: rev d1443988f809fe6656f60dfed4ee4e0f4844ee5c)

        • (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunCredentials.java
        • (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractDistCp.java
        • (delete) hadoop-tools/hadoop-aliyun/src/test/resources/log4j.properties
        • (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractCreate.java
        • (delete) hadoop-tools/hadoop-aliyun/dev-support/findbugs-exclude.xml
        • (delete) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSUtils.java
        • (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSTestUtils.java
        • (delete) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSFileSystemStore.java
        • (edit) hadoop-tools/pom.xml
        • (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunOSSOutputStream.java
        • (delete) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSInputStream.java
        • (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractSeek.java
        • (delete) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSFileSystem.java
        • (edit) hadoop-project/pom.xml
        • (delete) hadoop-tools/hadoop-aliyun/src/site/markdown/tools/hadoop-aliyun/index.md
        • (delete) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunCredentialsProvider.java
        • (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractDelete.java
        • (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/AliyunOSSContract.java
        • (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractGetFileStatus.java
        • (delete) hadoop-tools/hadoop-aliyun/src/test/resources/contract/aliyun-oss.xml
        • (delete) hadoop-tools/hadoop-aliyun/pom.xml
        • (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractOpen.java
        • (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunOSSFileSystemContract.java
        • (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractRootDir.java
        • (edit) .gitignore
        • (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractMkdir.java
        • (delete) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/package-info.java
        • (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunOSSFileSystemStore.java
        • (delete) hadoop-tools/hadoop-aliyun/src/test/resources/core-site.xml
        • (delete) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSOutputStream.java
        • (edit) hadoop-tools/hadoop-tools-dist/pom.xml
        • (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractRename.java
        • (delete) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/Constants.java
        • (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunOSSInputStream.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10502 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10502/ ) Revert " HADOOP-13584 . hdoop-aliyun: merge HADOOP-12756 branch back" This (kai.zheng: rev d1443988f809fe6656f60dfed4ee4e0f4844ee5c) (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunCredentials.java (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractDistCp.java (delete) hadoop-tools/hadoop-aliyun/src/test/resources/log4j.properties (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractCreate.java (delete) hadoop-tools/hadoop-aliyun/dev-support/findbugs-exclude.xml (delete) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSUtils.java (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSTestUtils.java (delete) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSFileSystemStore.java (edit) hadoop-tools/pom.xml (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunOSSOutputStream.java (delete) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSInputStream.java (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractSeek.java (delete) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSFileSystem.java (edit) hadoop-project/pom.xml (delete) hadoop-tools/hadoop-aliyun/src/site/markdown/tools/hadoop-aliyun/index.md (delete) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunCredentialsProvider.java (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractDelete.java (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/AliyunOSSContract.java (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractGetFileStatus.java (delete) hadoop-tools/hadoop-aliyun/src/test/resources/contract/aliyun-oss.xml (delete) hadoop-tools/hadoop-aliyun/pom.xml (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractOpen.java (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunOSSFileSystemContract.java (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractRootDir.java (edit) .gitignore (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractMkdir.java (delete) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/package-info.java (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunOSSFileSystemStore.java (delete) hadoop-tools/hadoop-aliyun/src/test/resources/core-site.xml (delete) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSOutputStream.java (edit) hadoop-tools/hadoop-tools-dist/pom.xml (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/contract/TestAliyunOSSContractRename.java (delete) hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/Constants.java (delete) hadoop-tools/hadoop-aliyun/src/test/java/org/apache/hadoop/fs/aliyun/oss/TestAliyunOSSInputStream.java
        Hide
        uncleGen Genmao Yu added a comment -

        rebase with trunk and add HADOOP-13701

        Show
        uncleGen Genmao Yu added a comment - rebase with trunk and add HADOOP-13701
        Hide
        drankye Kai Zheng added a comment -

        I have merged the branch to trunk via git merge --no-ff according to the vote result and the discussions in HADOOP-12756

        Show
        drankye Kai Zheng added a comment - I have merged the branch to trunk via git merge --no-ff according to the vote result and the discussions in HADOOP-12756

          People

          • Assignee:
            uncleGen Genmao Yu
            Reporter:
            shimingfei shimingfei
          • Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development