Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: build
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This is a follow up of HDFS-8052. It looks like HDFS-8052 breaks TestLocalJobSubmission in MR.

      HDFS-8052 moves the implementation of WebHdfsFileSystem and SWebHdfsFileSystem to hdfs-client.

      According the usage of ServiceLoader, the corresponding entries in hadoop-hdfs-project/hadoop-hdfs/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem should be moved as well.

      1. HDFS-9041.000.patch
        3 kB
        Mingliang Liu
      2. HDFS-9041.001.patch
        2 kB
        Mingliang Liu

        Activity

        Hide
        liuml07 Mingliang Liu added a comment -

        The v0 patch move the following entry in hadoop-hdfs-project/hadoop-hdfs/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem from hadoop-hdfs to hadoop-hdfs-client module.

        org.apache.hadoop.hdfs.web.WebHdfsFileSystem
        org.apache.hadoop.hdfs.web.SWebHdfsFileSystem
        
        Show
        liuml07 Mingliang Liu added a comment - The v0 patch move the following entry in hadoop-hdfs-project/hadoop-hdfs/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem from hadoop-hdfs to hadoop-hdfs-client module. org.apache.hadoop.hdfs.web.WebHdfsFileSystem org.apache.hadoop.hdfs.web.SWebHdfsFileSystem
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 15m 52s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
        +1 javac 8m 17s There were no new javac warning messages.
        +1 javadoc 10m 13s There were no new javadoc warning messages.
        +1 release audit 0m 25s The applied patch does not increase the total number of release audit warnings.
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
        +1 install 1m 33s mvn install still works.
        +1 eclipse:eclipse 0m 36s The patch built with eclipse:eclipse.
        +1 native 3m 21s Pre-build of native portion
        -1 hdfs tests 192m 4s Tests failed in hadoop-hdfs.
        +1 hdfs tests 0m 31s Tests passed in hadoop-hdfs-client.
            232m 56s  



        Reason Tests
        Failed unit tests hadoop.hdfs.TestReplaceDatanodeOnFailure
          hadoop.hdfs.server.blockmanagement.TestBlockManager



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12755040/HDFS-9041.000.patch
        Optional Tests javadoc javac unit
        git revision trunk / 7766610
        hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12376/artifact/patchprocess/testrun_hadoop-hdfs.txt
        hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12376/artifact/patchprocess/testrun_hadoop-hdfs-client.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12376/testReport/
        Java 1.7.0_55
        uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12376/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 15m 52s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 8m 17s There were no new javac warning messages. +1 javadoc 10m 13s There were no new javadoc warning messages. +1 release audit 0m 25s The applied patch does not increase the total number of release audit warnings. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 33s mvn install still works. +1 eclipse:eclipse 0m 36s The patch built with eclipse:eclipse. +1 native 3m 21s Pre-build of native portion -1 hdfs tests 192m 4s Tests failed in hadoop-hdfs. +1 hdfs tests 0m 31s Tests passed in hadoop-hdfs-client.     232m 56s   Reason Tests Failed unit tests hadoop.hdfs.TestReplaceDatanodeOnFailure   hadoop.hdfs.server.blockmanagement.TestBlockManager Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12755040/HDFS-9041.000.patch Optional Tests javadoc javac unit git revision trunk / 7766610 hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12376/artifact/patchprocess/testrun_hadoop-hdfs.txt hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12376/artifact/patchprocess/testrun_hadoop-hdfs-client.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12376/testReport/ Java 1.7.0_55 uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12376/console This message was automatically generated.
        Hide
        wheat9 Haohui Mai added a comment -
        +    <resources>
        +      <resource>
        +        <directory>${basedir}/src/main/resources</directory>
        +        <filtering>true</filtering>
        +        <includes>
        +          <include>META-INF/services/org.apache.hadoop.fs.FileSystem</include>
        +        </includes>
        +      </resource>
        +      <resource>
        +        <directory>${basedir}/src/main/resources</directory>
        +        <filtering>false</filtering>
        +        <excludes>
        +          <exclude>META-INF/services/org.apache.hadoop.fs.FileSystem</exclude>
        +        </excludes>
        +      </resource>
        +    </resources>
        

        There is no need to guard against variable substitution. Digging into the pom file a little bit it looks like the maven-resource plugin is loader all the time, thus I think it is safe to remove the above code snippet.

        Show
        wheat9 Haohui Mai added a comment - + <resources> + <resource> + <directory>${basedir}/src/main/resources</directory> + <filtering> true </filtering> + <includes> + <include>META-INF/services/org.apache.hadoop.fs.FileSystem</include> + </includes> + </resource> + <resource> + <directory>${basedir}/src/main/resources</directory> + <filtering> false </filtering> + <excludes> + <exclude>META-INF/services/org.apache.hadoop.fs.FileSystem</exclude> + </excludes> + </resource> + </resources> There is no need to guard against variable substitution. Digging into the pom file a little bit it looks like the maven-resource plugin is loader all the time, thus I think it is safe to remove the above code snippet.
        Hide
        liuml07 Mingliang Liu added a comment -

        Thank you Haohui Mai for your insight. The v1 patch addresses this.

        Show
        liuml07 Mingliang Liu added a comment - Thank you Haohui Mai for your insight. The v1 patch addresses this.
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 15m 54s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
        +1 javac 8m 1s There were no new javac warning messages.
        +1 javadoc 10m 28s There were no new javadoc warning messages.
        +1 release audit 0m 25s The applied patch does not increase the total number of release audit warnings.
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
        +1 install 1m 29s mvn install still works.
        +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
        +1 native 3m 15s Pre-build of native portion
        -1 hdfs tests 158m 52s Tests failed in hadoop-hdfs.
        +1 hdfs tests 0m 31s Tests passed in hadoop-hdfs-client.
            199m 31s  



        Reason Tests
        Failed unit tests hadoop.hdfs.security.TestDelegationToken
          hadoop.hdfs.web.TestWebHdfsWithAuthenticationFilter
          hadoop.hdfs.web.TestWebHdfsUrl
          hadoop.fs.TestSymlinkHdfsFileSystem
          hadoop.fs.TestSymlinkHdfsFileContext
          hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes
          hadoop.hdfs.web.TestWebHDFSXAttr
          hadoop.hdfs.web.TestWebHdfsTimeouts
          hadoop.hdfs.security.TestDelegationTokenForProxyUser
          hadoop.hdfs.web.TestWebHdfsFileSystemContract
          hadoop.hdfs.web.TestWebHDFSAcl
          hadoop.hdfs.web.TestWebHDFS
          hadoop.hdfs.web.TestWebHDFSForHA
          hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary
          hadoop.hdfs.TestEncryptionZonesWithKMS
          hadoop.hdfs.TestEncryptionZones
          hadoop.hdfs.web.TestWebHdfsTokens
          hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer
          hadoop.hdfs.TestQuota
          hadoop.hdfs.web.TestFSMainOperationsWebHdfs
          hadoop.hdfs.server.namenode.TestAuditLogs
          hadoop.hdfs.web.TestHttpsFileSystem
          hadoop.hdfs.web.TestWebHdfsContentLength
          hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr
          hadoop.hdfs.TestDistributedFileSystem
          hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12755268/HDFS-9041.001.patch
        Optional Tests javadoc javac unit
        git revision trunk / f103a70
        hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12382/artifact/patchprocess/testrun_hadoop-hdfs.txt
        hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12382/artifact/patchprocess/testrun_hadoop-hdfs-client.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12382/testReport/
        Java 1.7.0_55
        uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12382/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 15m 54s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 8m 1s There were no new javac warning messages. +1 javadoc 10m 28s There were no new javadoc warning messages. +1 release audit 0m 25s The applied patch does not increase the total number of release audit warnings. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 29s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. +1 native 3m 15s Pre-build of native portion -1 hdfs tests 158m 52s Tests failed in hadoop-hdfs. +1 hdfs tests 0m 31s Tests passed in hadoop-hdfs-client.     199m 31s   Reason Tests Failed unit tests hadoop.hdfs.security.TestDelegationToken   hadoop.hdfs.web.TestWebHdfsWithAuthenticationFilter   hadoop.hdfs.web.TestWebHdfsUrl   hadoop.fs.TestSymlinkHdfsFileSystem   hadoop.fs.TestSymlinkHdfsFileContext   hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes   hadoop.hdfs.web.TestWebHDFSXAttr   hadoop.hdfs.web.TestWebHdfsTimeouts   hadoop.hdfs.security.TestDelegationTokenForProxyUser   hadoop.hdfs.web.TestWebHdfsFileSystemContract   hadoop.hdfs.web.TestWebHDFSAcl   hadoop.hdfs.web.TestWebHDFS   hadoop.hdfs.web.TestWebHDFSForHA   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary   hadoop.hdfs.TestEncryptionZonesWithKMS   hadoop.hdfs.TestEncryptionZones   hadoop.hdfs.web.TestWebHdfsTokens   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer   hadoop.hdfs.TestQuota   hadoop.hdfs.web.TestFSMainOperationsWebHdfs   hadoop.hdfs.server.namenode.TestAuditLogs   hadoop.hdfs.web.TestHttpsFileSystem   hadoop.hdfs.web.TestWebHdfsContentLength   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr   hadoop.hdfs.TestDistributedFileSystem   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12755268/HDFS-9041.001.patch Optional Tests javadoc javac unit git revision trunk / f103a70 hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12382/artifact/patchprocess/testrun_hadoop-hdfs.txt hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12382/artifact/patchprocess/testrun_hadoop-hdfs-client.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12382/testReport/ Java 1.7.0_55 uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12382/console This message was automatically generated.
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 15m 37s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
        +1 javac 7m 59s There were no new javac warning messages.
        +1 javadoc 10m 18s There were no new javadoc warning messages.
        +1 release audit 0m 25s The applied patch does not increase the total number of release audit warnings.
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
        +1 install 1m 30s mvn install still works.
        +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
        +1 native 3m 15s Pre-build of native portion
        -1 hdfs tests 156m 56s Tests failed in hadoop-hdfs.
        +1 hdfs tests 0m 29s Tests passed in hadoop-hdfs-client.
            197m 6s  



        Reason Tests
        Failed unit tests hadoop.hdfs.server.namenode.TestAuditLogger
          hadoop.hdfs.web.TestWebHDFSXAttr
          hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary
          hadoop.hdfs.security.TestDelegationToken
          hadoop.hdfs.web.TestWebHDFSForHA
          hadoop.hdfs.web.TestWebHdfsWithAuthenticationFilter
          hadoop.hdfs.web.TestWebHdfsTimeouts
          hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr
          hadoop.hdfs.TestDistributedFileSystem
          hadoop.hdfs.security.TestDelegationTokenForProxyUser
          hadoop.fs.TestSymlinkHdfsFileSystem
          hadoop.hdfs.web.TestWebHdfsTokens
          hadoop.hdfs.TestEncryptionZonesWithKMS
          hadoop.hdfs.web.TestWebHdfsUrl
          hadoop.hdfs.TestQuota
          hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes
          hadoop.fs.TestSymlinkHdfsFileContext
          hadoop.hdfs.web.TestWebHDFSAcl
          hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes
          hadoop.hdfs.web.TestHttpsFileSystem
          hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl
          hadoop.hdfs.web.TestWebHdfsContentLength
          hadoop.hdfs.web.TestFSMainOperationsWebHdfs
          hadoop.hdfs.web.TestWebHdfsFileSystemContract
          hadoop.hdfs.web.TestWebHDFS
          hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer
        Timed out tests org.apache.hadoop.fs.contract.hdfs.TestHDFSContractConcat



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12755268/HDFS-9041.001.patch
        Optional Tests javadoc javac unit
        git revision trunk / f103a70
        hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12386/artifact/patchprocess/testrun_hadoop-hdfs.txt
        hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12386/artifact/patchprocess/testrun_hadoop-hdfs-client.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12386/testReport/
        Java 1.7.0_55
        uname Linux asf907.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12386/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 15m 37s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 7m 59s There were no new javac warning messages. +1 javadoc 10m 18s There were no new javadoc warning messages. +1 release audit 0m 25s The applied patch does not increase the total number of release audit warnings. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 30s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 native 3m 15s Pre-build of native portion -1 hdfs tests 156m 56s Tests failed in hadoop-hdfs. +1 hdfs tests 0m 29s Tests passed in hadoop-hdfs-client.     197m 6s   Reason Tests Failed unit tests hadoop.hdfs.server.namenode.TestAuditLogger   hadoop.hdfs.web.TestWebHDFSXAttr   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary   hadoop.hdfs.security.TestDelegationToken   hadoop.hdfs.web.TestWebHDFSForHA   hadoop.hdfs.web.TestWebHdfsWithAuthenticationFilter   hadoop.hdfs.web.TestWebHdfsTimeouts   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr   hadoop.hdfs.TestDistributedFileSystem   hadoop.hdfs.security.TestDelegationTokenForProxyUser   hadoop.fs.TestSymlinkHdfsFileSystem   hadoop.hdfs.web.TestWebHdfsTokens   hadoop.hdfs.TestEncryptionZonesWithKMS   hadoop.hdfs.web.TestWebHdfsUrl   hadoop.hdfs.TestQuota   hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes   hadoop.fs.TestSymlinkHdfsFileContext   hadoop.hdfs.web.TestWebHDFSAcl   hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes   hadoop.hdfs.web.TestHttpsFileSystem   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl   hadoop.hdfs.web.TestWebHdfsContentLength   hadoop.hdfs.web.TestFSMainOperationsWebHdfs   hadoop.hdfs.web.TestWebHdfsFileSystemContract   hadoop.hdfs.web.TestWebHDFS   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer Timed out tests org.apache.hadoop.fs.contract.hdfs.TestHDFSContractConcat Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12755268/HDFS-9041.001.patch Optional Tests javadoc javac unit git revision trunk / f103a70 hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12386/artifact/patchprocess/testrun_hadoop-hdfs.txt hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12386/artifact/patchprocess/testrun_hadoop-hdfs-client.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12386/testReport/ Java 1.7.0_55 uname Linux asf907.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12386/console This message was automatically generated.
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 15m 36s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
        +1 javac 7m 52s There were no new javac warning messages.
        +1 javadoc 10m 9s There were no new javadoc warning messages.
        +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
        +1 install 1m 29s mvn install still works.
        +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
        +1 native 3m 10s Pre-build of native portion
        -1 hdfs tests 85m 26s Tests failed in hadoop-hdfs.
        +1 hdfs tests 0m 28s Tests passed in hadoop-hdfs-client.
            125m 10s  



        Reason Tests
        Failed unit tests hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory
          hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter
          hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement
        Timed out tests org.apache.hadoop.hdfs.TestSafeMode



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12755268/HDFS-9041.001.patch
        Optional Tests javadoc javac unit
        git revision trunk / 9538af0
        hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12407/artifact/patchprocess/testrun_hadoop-hdfs.txt
        hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12407/artifact/patchprocess/testrun_hadoop-hdfs-client.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12407/testReport/
        Java 1.7.0_55
        uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12407/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 15m 36s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 7m 52s There were no new javac warning messages. +1 javadoc 10m 9s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 29s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 native 3m 10s Pre-build of native portion -1 hdfs tests 85m 26s Tests failed in hadoop-hdfs. +1 hdfs tests 0m 28s Tests passed in hadoop-hdfs-client.     125m 10s   Reason Tests Failed unit tests hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement Timed out tests org.apache.hadoop.hdfs.TestSafeMode Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12755268/HDFS-9041.001.patch Optional Tests javadoc javac unit git revision trunk / 9538af0 hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12407/artifact/patchprocess/testrun_hadoop-hdfs.txt hadoop-hdfs-client test log https://builds.apache.org/job/PreCommit-HDFS-Build/12407/artifact/patchprocess/testrun_hadoop-hdfs-client.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12407/testReport/ Java 1.7.0_55 uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12407/console This message was automatically generated.
        Hide
        wheat9 Haohui Mai added a comment -

        The test failures are unrelated. TestSafeMode did not fail in the test report, and TestLazyWriter is failing in trunk. Filed HDFS-9067 to track the failures.

        The patch looks good to me. +1. I'll commit it shortly.

        Show
        wheat9 Haohui Mai added a comment - The test failures are unrelated. TestSafeMode did not fail in the test report, and TestLazyWriter is failing in trunk. Filed HDFS-9067 to track the failures. The patch looks good to me. +1. I'll commit it shortly.
        Hide
        wheat9 Haohui Mai added a comment -

        I've committed the patch to trunk and branch-2. Thanks Mingliang Liu for the contribution.

        Show
        wheat9 Haohui Mai added a comment - I've committed the patch to trunk and branch-2. Thanks Mingliang Liu for the contribution.
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-trunk-Commit #8443 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8443/)
        HDFS-9041. Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. (wheat9: rev 0c7d3f480548745e9e9ccad1d318371c020c3003)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs-client/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8443 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8443/ ) HDFS-9041 . Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. (wheat9: rev 0c7d3f480548745e9e9ccad1d318371c020c3003) hadoop-hdfs-project/hadoop-hdfs/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs-client/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #379 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/379/)
        HDFS-9041. Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. (wheat9: rev 0c7d3f480548745e9e9ccad1d318371c020c3003)

        • hadoop-hdfs-project/hadoop-hdfs-client/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
        • hadoop-hdfs-project/hadoop-hdfs/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #379 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/379/ ) HDFS-9041 . Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. (wheat9: rev 0c7d3f480548745e9e9ccad1d318371c020c3003) hadoop-hdfs-project/hadoop-hdfs-client/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem hadoop-hdfs-project/hadoop-hdfs/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #385 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/385/)
        HDFS-9041. Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. (wheat9: rev 0c7d3f480548745e9e9ccad1d318371c020c3003)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
        • hadoop-hdfs-project/hadoop-hdfs-client/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #385 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/385/ ) HDFS-9041 . Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. (wheat9: rev 0c7d3f480548745e9e9ccad1d318371c020c3003) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem hadoop-hdfs-project/hadoop-hdfs-client/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Yarn-trunk #1117 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1117/)
        HDFS-9041. Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. (wheat9: rev 0c7d3f480548745e9e9ccad1d318371c020c3003)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
        • hadoop-hdfs-project/hadoop-hdfs-client/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #1117 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1117/ ) HDFS-9041 . Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. (wheat9: rev 0c7d3f480548745e9e9ccad1d318371c020c3003) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem hadoop-hdfs-project/hadoop-hdfs-client/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2327 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2327/)
        HDFS-9041. Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. (wheat9: rev 0c7d3f480548745e9e9ccad1d318371c020c3003)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs-client/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2327 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2327/ ) HDFS-9041 . Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. (wheat9: rev 0c7d3f480548745e9e9ccad1d318371c020c3003) hadoop-hdfs-project/hadoop-hdfs/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs-client/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #364 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/364/)
        HDFS-9041. Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. (wheat9: rev 0c7d3f480548745e9e9ccad1d318371c020c3003)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs-client/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
        • hadoop-hdfs-project/hadoop-hdfs/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #364 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/364/ ) HDFS-9041 . Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. (wheat9: rev 0c7d3f480548745e9e9ccad1d318371c020c3003) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs-client/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem hadoop-hdfs-project/hadoop-hdfs/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk #2304 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2304/)
        HDFS-9041. Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. (wheat9: rev 0c7d3f480548745e9e9ccad1d318371c020c3003)

        • hadoop-hdfs-project/hadoop-hdfs-client/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2304 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2304/ ) HDFS-9041 . Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. (wheat9: rev 0c7d3f480548745e9e9ccad1d318371c020c3003) hadoop-hdfs-project/hadoop-hdfs-client/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem

          People

          • Assignee:
            liuml07 Mingliang Liu
            Reporter:
            wheat9 Haohui Mai
          • Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development