Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8512

WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: webhdfs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Storage type inside LocatedBlock object is not fully exposed for GETFILESTATUS

      $ curl -i "http://127.0.0.1:50070/webhdfs/v1/HOT/FILE1?user.name=xyao&op=GETFILESTATUS"
      HTTP/1.1 200 OK
      Cache-Control: no-cache
      Expires: Wed, 27 May 2015 18:04:13 GMT
      Date: Wed, 27 May 2015 18:04:13 GMT
      Pragma: no-cache
      Expires: Wed, 27 May 2015 18:04:13 GMT
      Date: Wed, 27 May 2015 18:04:13 GMT
      Pragma: no-cache
      Content-Type: application/json
      Set-Cookie: hadoop.auth="u=xyao&p=xyao&t=simple&e=1432785853423&s=W4O5kKiYHmzzey4h7I9J9eL9EMY="; Path=/; Expires=Thu, 28-May-2015 04:04:13 GMT; HttpOnly
      Transfer-Encoding: chunked
      Server: Jetty(6.1.26)
       
      {"FileStatus":{"accessTime":1432683737985,"blockSize":134217728,"childrenNum":0,"fileId":16405,"group":"hadoop","length":150318178,"modificationTime":1432683738427,"owner":"xyao","pathSuffix":"","permission":"644","replication":1,"storagePolicy":7,"type":"FILE"}}
       $ curl -i "http://127.0.0.1:50070/webhdfs/v1/HOT/FILE1?user.name=xyao&op=GET_BLOCK_LOCATIONS&offset=0&length=150318178"
      HTTP/1.1 200 OK
      Cache-Control: no-cache
      Expires: Wed, 27 May 2015 18:04:55 GMT
      Date: Wed, 27 May 2015 18:04:55 GMT
      Pragma: no-cache
      Expires: Wed, 27 May 2015 18:04:55 GMT
      Date: Wed, 27 May 2015 18:04:55 GMT
      Pragma: no-cache
      Content-Type: application/json
      Set-Cookie: hadoop.auth="u=xyao&p=xyao&t=simple&e=1432785895031&s=TUiaNsCrARAPKz6xrddoQ1eHOXA="; Path=/; Expires=Thu, 28-May-2015 04:04:55 GMT; HttpOnly
      Transfer-Encoding: chunked
      Server: Jetty(6.1.26)
       
      {"LocatedBlocks":{"fileLength":150318178,"isLastBlockComplete":true,"isUnderConstruction":false,"lastLocatedBlock":{"block":{"blockId":1073741847,"blockPoolId":"BP-474445704-192.168.70.1-1432674221011","generationStamp":1023,"numBytes":16100450},"blockToken":{"urlString":"AAAAAA"},"cachedLocations":[],"isCorrupt":false,"locations":[{"adminState":"NORMAL","blockPoolUsed":300670976,"cacheCapacity":0,"cacheUsed":0,"capacity":1996329943040,"dfsUsed":300670976,"hostName":"192.168.70.1","infoPort":50075,"infoSecurePort":0,"ipAddr":"192.168.70.1","ipcPort":50020,"lastUpdate":1432749892058,"lastUpdateMonotonic":1432749892058,"name":"192.168.70.1:50010","networkLocation":"/default-rack","remaining":782138327040,"storageID":"49a30d0f-99f8-4b87-b986-502fe926271a","xceiverCount":1,"xferPort":50010}],"startOffset":134217728},"locatedBlocks":[{"block":{"blockId":1073741846,"blockPoolId":"BP-474445704-192.168.70.1-1432674221011","generationStamp":1022,"numBytes":134217728},"blockToken":{"urlString":"AAAAAA"},"cachedLocations":[],"isCorrupt":false,"locations":[{"adminState":"NORMAL","blockPoolUsed":300670976,"cacheCapacity":0,"cacheUsed":0,"capacity":1996329943040,"dfsUsed":300670976,"hostName":"192.168.70.1","infoPort":50075,"infoSecurePort":0,"ipAddr":"192.168.70.1","ipcPort":50020,"lastUpdate":1432749892058,"lastUpdateMonotonic":1432749892058,"name":"192.168.70.1:50010","networkLocation":"/default-rack","remaining":782138327040,"storageID":"49a30d0f-99f8-4b87-b986-502fe926271a","xceiverCount":1,"xferPort":50010}],"startOffset":0},{"block":{"blockId":1073741847,"blockPoolId":"BP-474445704-192.168.70.1-1432674221011","generationStamp":1023,"numBytes":16100450},"blockToken":{"urlString":"AAAAAA"},"cachedLocations":[],"isCorrupt":false,"locations":[{"adminState":"NORMAL","blockPoolUsed":300670976,"cacheCapacity":0,"cacheUsed":0,"capacity":1996329943040,"dfsUsed":300670976,"hostName":"192.168.70.1","infoPort":50075,"infoSecurePort":0,"ipAddr":"192.168.70.1","ipcPort":50020,"lastUpdate":1432749892058,"lastUpdateMonotonic":1432749892058,"name":"192.168.70.1:50010","networkLocation":"/default-rack","remaining":782138327040,"storageID":"49a30d0f-99f8-4b87-b986-502fe926271a","xceiverCount":1,"xferPort":50010}],"startOffset":134217728}]}}
      
      1. HDFS-8512.01.patch
        5 kB
        Xiaoyu Yao
      2. HDFS-8512.00.patch
        6 kB
        Xiaoyu Yao

        Issue Links

          Activity

          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2581 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2581/)
          HDFS-8512. WebHDFS : GETFILESTATUS should return LocatedBlock with (xyao: rev e3d673901b396cf5bbede5ed6f607ce68301ec0a)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/JsonUtilClient.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2581 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2581/ ) HDFS-8512 . WebHDFS : GETFILESTATUS should return LocatedBlock with (xyao: rev e3d673901b396cf5bbede5ed6f607ce68301ec0a) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/JsonUtilClient.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #644 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/644/)
          HDFS-8512. WebHDFS : GETFILESTATUS should return LocatedBlock with (xyao: rev e3d673901b396cf5bbede5ed6f607ce68301ec0a)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/JsonUtilClient.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #644 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/644/ ) HDFS-8512 . WebHDFS : GETFILESTATUS should return LocatedBlock with (xyao: rev e3d673901b396cf5bbede5ed6f607ce68301ec0a) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/JsonUtilClient.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2667 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2667/)
          HDFS-8512. WebHDFS : GETFILESTATUS should return LocatedBlock with (xyao: rev e3d673901b396cf5bbede5ed6f607ce68301ec0a)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/JsonUtilClient.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2667 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2667/ ) HDFS-8512 . WebHDFS : GETFILESTATUS should return LocatedBlock with (xyao: rev e3d673901b396cf5bbede5ed6f607ce68301ec0a) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/JsonUtilClient.java
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Yarn-trunk #1456 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1456/)
          HDFS-8512. WebHDFS : GETFILESTATUS should return LocatedBlock with (xyao: rev e3d673901b396cf5bbede5ed6f607ce68301ec0a)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/JsonUtilClient.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #1456 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1456/ ) HDFS-8512 . WebHDFS : GETFILESTATUS should return LocatedBlock with (xyao: rev e3d673901b396cf5bbede5ed6f607ce68301ec0a) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/JsonUtilClient.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #724 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/724/)
          HDFS-8512. WebHDFS : GETFILESTATUS should return LocatedBlock with (xyao: rev e3d673901b396cf5bbede5ed6f607ce68301ec0a)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/JsonUtilClient.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #724 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/724/ ) HDFS-8512 . WebHDFS : GETFILESTATUS should return LocatedBlock with (xyao: rev e3d673901b396cf5bbede5ed6f607ce68301ec0a) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/JsonUtilClient.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #735 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/735/)
          HDFS-8512. WebHDFS : GETFILESTATUS should return LocatedBlock with (xyao: rev e3d673901b396cf5bbede5ed6f607ce68301ec0a)

          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/JsonUtilClient.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #735 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/735/ ) HDFS-8512 . WebHDFS : GETFILESTATUS should return LocatedBlock with (xyao: rev e3d673901b396cf5bbede5ed6f607ce68301ec0a) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/JsonUtilClient.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #8893 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8893/)
          HDFS-8512. WebHDFS : GETFILESTATUS should return LocatedBlock with (xyao: rev e3d673901b396cf5bbede5ed6f607ce68301ec0a)

          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/JsonUtilClient.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8893 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8893/ ) HDFS-8512 . WebHDFS : GETFILESTATUS should return LocatedBlock with (xyao: rev e3d673901b396cf5bbede5ed6f607ce68301ec0a) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/JsonUtilClient.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          xyao Xiaoyu Yao added a comment -

          Thanks Tsz Wo Nicholas Sze for the review! I've committed the patch to trunk and branch-2.

          Show
          xyao Xiaoyu Yao added a comment - Thanks Tsz Wo Nicholas Sze for the review! I've committed the patch to trunk and branch-2.
          Hide
          szetszwo Tsz Wo Nicholas Sze added a comment -

          +1 on the new patch.

          Show
          szetszwo Tsz Wo Nicholas Sze added a comment - +1 on the new patch.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 0s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          +1 mvninstall 7m 34s trunk passed
          +1 compile 1m 27s trunk passed with JDK v1.8.0_66
          +1 compile 1m 30s trunk passed with JDK v1.7.0_85
          +1 checkstyle 0m 21s trunk passed
          +1 mvnsite 1m 24s trunk passed
          +1 mvneclipse 0m 26s trunk passed
          +1 findbugs 3m 41s trunk passed
          +1 javadoc 1m 24s trunk passed with JDK v1.8.0_66
          +1 javadoc 2m 8s trunk passed with JDK v1.7.0_85
          +1 mvninstall 1m 20s the patch passed
          +1 compile 1m 23s the patch passed with JDK v1.8.0_66
          +1 javac 1m 23s the patch passed
          +1 compile 1m 28s the patch passed with JDK v1.7.0_85
          +1 javac 1m 28s the patch passed
          +1 checkstyle 0m 20s the patch passed
          +1 mvnsite 1m 24s the patch passed
          +1 mvneclipse 0m 26s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 findbugs 4m 1s the patch passed
          +1 javadoc 1m 23s the patch passed with JDK v1.8.0_66
          +1 javadoc 2m 10s the patch passed with JDK v1.7.0_85
          -1 unit 52m 27s hadoop-hdfs in the patch failed with JDK v1.8.0_66.
          +1 unit 0m 53s hadoop-hdfs-client in the patch passed with JDK v1.8.0_66.
          -1 unit 50m 4s hadoop-hdfs in the patch failed with JDK v1.7.0_85.
          +1 unit 0m 58s hadoop-hdfs-client in the patch passed with JDK v1.7.0_85.
          -1 asflicense 0m 19s Patch generated 58 ASF License warnings.
          141m 26s



          Reason Tests
          JDK v1.8.0_66 Failed junit tests hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure
            hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes
            hadoop.hdfs.TestCrcCorruption
            hadoop.security.TestPermission
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure160
            hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150
          JDK v1.7.0_85 Failed junit tests hadoop.security.TestPermission
            hadoop.hdfs.TestParallelShortCircuitReadUnCached



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:0ca8df7
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12774158/HDFS-8512.01.patch
          JIRA Issue HDFS-8512
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux bd4aa9014a37 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 4ac6799
          findbugs v3.0.0
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/13647/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/13647/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_85.txt
          unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13647/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13647/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_85.txt
          JDK v1.7.0_85 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13647/testReport/
          asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13647/artifact/patchprocess/patch-asflicense-problems.txt
          modules C: hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-client U: hadoop-hdfs-project
          Max memory used 75MB
          Powered by Apache Yetus http://yetus.apache.org
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13647/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 7m 34s trunk passed +1 compile 1m 27s trunk passed with JDK v1.8.0_66 +1 compile 1m 30s trunk passed with JDK v1.7.0_85 +1 checkstyle 0m 21s trunk passed +1 mvnsite 1m 24s trunk passed +1 mvneclipse 0m 26s trunk passed +1 findbugs 3m 41s trunk passed +1 javadoc 1m 24s trunk passed with JDK v1.8.0_66 +1 javadoc 2m 8s trunk passed with JDK v1.7.0_85 +1 mvninstall 1m 20s the patch passed +1 compile 1m 23s the patch passed with JDK v1.8.0_66 +1 javac 1m 23s the patch passed +1 compile 1m 28s the patch passed with JDK v1.7.0_85 +1 javac 1m 28s the patch passed +1 checkstyle 0m 20s the patch passed +1 mvnsite 1m 24s the patch passed +1 mvneclipse 0m 26s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 4m 1s the patch passed +1 javadoc 1m 23s the patch passed with JDK v1.8.0_66 +1 javadoc 2m 10s the patch passed with JDK v1.7.0_85 -1 unit 52m 27s hadoop-hdfs in the patch failed with JDK v1.8.0_66. +1 unit 0m 53s hadoop-hdfs-client in the patch passed with JDK v1.8.0_66. -1 unit 50m 4s hadoop-hdfs in the patch failed with JDK v1.7.0_85. +1 unit 0m 58s hadoop-hdfs-client in the patch passed with JDK v1.7.0_85. -1 asflicense 0m 19s Patch generated 58 ASF License warnings. 141m 26s Reason Tests JDK v1.8.0_66 Failed junit tests hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure   hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes   hadoop.hdfs.TestCrcCorruption   hadoop.security.TestPermission   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure160   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150 JDK v1.7.0_85 Failed junit tests hadoop.security.TestPermission   hadoop.hdfs.TestParallelShortCircuitReadUnCached Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12774158/HDFS-8512.01.patch JIRA Issue HDFS-8512 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux bd4aa9014a37 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 4ac6799 findbugs v3.0.0 unit https://builds.apache.org/job/PreCommit-HDFS-Build/13647/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/13647/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_85.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13647/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_66.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13647/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_85.txt JDK v1.7.0_85 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13647/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13647/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-client U: hadoop-hdfs-project Max memory used 75MB Powered by Apache Yetus http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13647/console This message was automatically generated.
          Hide
          xyao Xiaoyu Yao added a comment -

          Thanks Tsz Wo Nicholas Sze for the review. Rebase the patch to trunk.

          Show
          xyao Xiaoyu Yao added a comment - Thanks Tsz Wo Nicholas Sze for the review. Rebase the patch to trunk.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          -1 patch 0m 8s HDFS-8512 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.



          Subsystem Report/Notes
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12766498/HDFS-8512.00.patch
          JIRA Issue HDFS-8512
          Powered by Apache Yetus http://yetus.apache.org
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13640/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 patch 0m 8s HDFS-8512 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help. Subsystem Report/Notes JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12766498/HDFS-8512.00.patch JIRA Issue HDFS-8512 Powered by Apache Yetus http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13640/console This message was automatically generated.
          Hide
          szetszwo Tsz Wo Nicholas Sze added a comment -

          +1 patch looks good.

          Show
          szetszwo Tsz Wo Nicholas Sze added a comment - +1 patch looks good.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          -1 pre-patch 26m 36s Pre-patch trunk has 1 extant Findbugs (version 3.0.0) warnings.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
          +1 javac 12m 27s There were no new javac warning messages.
          +1 javadoc 14m 36s There were no new javadoc warning messages.
          +1 release audit 0m 32s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 3m 55s There were no new checkstyle issues.
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 install 1m 58s mvn install still works.
          +1 eclipse:eclipse 0m 44s The patch built with eclipse:eclipse.
          +1 findbugs 6m 7s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 native 4m 12s Pre-build of native portion
          -1 hdfs tests 64m 58s Tests failed in hadoop-hdfs.
          +1 hdfs tests 0m 41s Tests passed in hadoop-hdfs-client.
              136m 50s  



          Reason Tests
          Failed unit tests hadoop.hdfs.TestRecoverStripedFile
            hadoop.hdfs.TestReplaceDatanodeOnFailure
          Timed out tests org.apache.hadoop.hdfs.server.blockmanagement.TestPendingReplication



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12766498/HDFS-8512.00.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / 2a98724
          Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12975/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12975/artifact/patchprocess/testrun_hadoop-hdfs.txt
          hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12975/artifact/patchprocess/testrun_hadoop-hdfs-client.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12975/testReport/
          Java 1.7.0_55
          uname Linux asf907.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12975/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 pre-patch 26m 36s Pre-patch trunk has 1 extant Findbugs (version 3.0.0) warnings. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 12m 27s There were no new javac warning messages. +1 javadoc 14m 36s There were no new javadoc warning messages. +1 release audit 0m 32s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 3m 55s There were no new checkstyle issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 58s mvn install still works. +1 eclipse:eclipse 0m 44s The patch built with eclipse:eclipse. +1 findbugs 6m 7s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 4m 12s Pre-build of native portion -1 hdfs tests 64m 58s Tests failed in hadoop-hdfs. +1 hdfs tests 0m 41s Tests passed in hadoop-hdfs-client.     136m 50s   Reason Tests Failed unit tests hadoop.hdfs.TestRecoverStripedFile   hadoop.hdfs.TestReplaceDatanodeOnFailure Timed out tests org.apache.hadoop.hdfs.server.blockmanagement.TestPendingReplication Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12766498/HDFS-8512.00.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 2a98724 Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12975/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12975/artifact/patchprocess/testrun_hadoop-hdfs.txt hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12975/artifact/patchprocess/testrun_hadoop-hdfs-client.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12975/testReport/ Java 1.7.0_55 uname Linux asf907.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12975/console This message was automatically generated.

            People

            • Assignee:
              xyao Xiaoyu Yao
              Reporter:
              ssathish@hortonworks.com Sumana Sathish
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development