Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9743

Fix TestLazyPersistFiles#testFallbackToDiskFull in branch-2.7

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.2
    • Fix Version/s: 2.7.3
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      The corresponding test case has been moved and fixed in trunk by HDFS-9073 and HDFS-9067. We should fix it in branch-2.7 too, but it will need a different patch.

        Activity

        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 0s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        -1 mvndep 0m 47s branch's hadoop-hdfs-project/hadoop-hdfs dependency:list failed
        0 mvndep 0m 47s Maven dependency ordering for branch
        -1 mvninstall 2m 14s root in branch-2.7 failed.
        -1 compile 0m 11s hadoop-hdfs in branch-2.7 failed with JDK v1.8.0_72.
        -1 compile 0m 10s hadoop-hdfs in branch-2.7 failed with JDK v1.7.0_95.
        +1 checkstyle 0m 9s branch-2.7 passed
        -1 mvnsite 0m 10s hadoop-hdfs in branch-2.7 failed.
        -1 mvneclipse 0m 13s hadoop-hdfs in branch-2.7 failed.
        -1 findbugs 0m 8s hadoop-hdfs in branch-2.7 failed.
        -1 javadoc 0m 8s hadoop-hdfs in branch-2.7 failed with JDK v1.8.0_72.
        -1 javadoc 0m 8s hadoop-hdfs in branch-2.7 failed with JDK v1.7.0_95.
        -1 mvndep 0m 8s patch's hadoop-hdfs-project/hadoop-hdfs dependency:list failed
        0 mvndep 0m 9s Maven dependency ordering for patch
        -1 mvninstall 0m 9s hadoop-hdfs in the patch failed.
        -1 compile 0m 8s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
        -1 javac 0m 8s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
        -1 compile 0m 9s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
        -1 javac 0m 9s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
        +1 checkstyle 0m 9s the patch passed
        -1 mvnsite 0m 8s hadoop-hdfs in the patch failed.
        -1 mvneclipse 0m 9s hadoop-hdfs in the patch failed.
        -1 whitespace 0m 2s The patch has 427 line(s) that end in whitespace. Use git apply --whitespace=fix.
        -1 whitespace 0m 13s The patch has 41 line(s) with tabs.
        -1 findbugs 0m 9s hadoop-hdfs in the patch failed.
        -1 javadoc 0m 10s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
        -1 javadoc 0m 7s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
        -1 unit 0m 7s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
        -1 unit 0m 7s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
        -1 asflicense 52m 19s Patch generated 59 ASF License warnings.
        60m 29s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:date2016-02-02
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12785857/HDFS-9743-branch-2.7.001.patch
        JIRA Issue HDFS-9743
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux df51476d1fee 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision branch-2.7 / 7f6d150
        Default Java 1.7.0_95
        Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
        mvndep hadoop-hdfs-project_hadoop-hdfs: https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/maven-branch-dependencylist-hadoop-hdfs-project_hadoop-hdfs.txt
        mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/branch-mvninstall-root.txt
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
        mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/branch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt
        mvneclipse https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/branch-mvneclipse-hadoop-hdfs-project_hadoop-hdfs.txt
        findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt
        javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
        mvndep hadoop-hdfs-project_hadoop-hdfs: https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/maven-patch-dependencylist-hadoop-hdfs-project_hadoop-hdfs.txt
        mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs.txt
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        javac https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        compile https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
        javac https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
        mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt
        mvneclipse https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-mvneclipse-hadoop-hdfs-project_hadoop-hdfs.txt
        whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/whitespace-eol.txt
        whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/whitespace-tabs.txt
        findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt
        javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
        JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14348/testReport/
        asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-asflicense-problems.txt
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Max memory used 45MB
        Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14348/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. -1 mvndep 0m 47s branch's hadoop-hdfs-project/hadoop-hdfs dependency:list failed 0 mvndep 0m 47s Maven dependency ordering for branch -1 mvninstall 2m 14s root in branch-2.7 failed. -1 compile 0m 11s hadoop-hdfs in branch-2.7 failed with JDK v1.8.0_72. -1 compile 0m 10s hadoop-hdfs in branch-2.7 failed with JDK v1.7.0_95. +1 checkstyle 0m 9s branch-2.7 passed -1 mvnsite 0m 10s hadoop-hdfs in branch-2.7 failed. -1 mvneclipse 0m 13s hadoop-hdfs in branch-2.7 failed. -1 findbugs 0m 8s hadoop-hdfs in branch-2.7 failed. -1 javadoc 0m 8s hadoop-hdfs in branch-2.7 failed with JDK v1.8.0_72. -1 javadoc 0m 8s hadoop-hdfs in branch-2.7 failed with JDK v1.7.0_95. -1 mvndep 0m 8s patch's hadoop-hdfs-project/hadoop-hdfs dependency:list failed 0 mvndep 0m 9s Maven dependency ordering for patch -1 mvninstall 0m 9s hadoop-hdfs in the patch failed. -1 compile 0m 8s hadoop-hdfs in the patch failed with JDK v1.8.0_72. -1 javac 0m 8s hadoop-hdfs in the patch failed with JDK v1.8.0_72. -1 compile 0m 9s hadoop-hdfs in the patch failed with JDK v1.7.0_95. -1 javac 0m 9s hadoop-hdfs in the patch failed with JDK v1.7.0_95. +1 checkstyle 0m 9s the patch passed -1 mvnsite 0m 8s hadoop-hdfs in the patch failed. -1 mvneclipse 0m 9s hadoop-hdfs in the patch failed. -1 whitespace 0m 2s The patch has 427 line(s) that end in whitespace. Use git apply --whitespace=fix. -1 whitespace 0m 13s The patch has 41 line(s) with tabs. -1 findbugs 0m 9s hadoop-hdfs in the patch failed. -1 javadoc 0m 10s hadoop-hdfs in the patch failed with JDK v1.8.0_72. -1 javadoc 0m 7s hadoop-hdfs in the patch failed with JDK v1.7.0_95. -1 unit 0m 7s hadoop-hdfs in the patch failed with JDK v1.8.0_72. -1 unit 0m 7s hadoop-hdfs in the patch failed with JDK v1.7.0_95. -1 asflicense 52m 19s Patch generated 59 ASF License warnings. 60m 29s Subsystem Report/Notes Docker Image:yetus/hadoop:date2016-02-02 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12785857/HDFS-9743-branch-2.7.001.patch JIRA Issue HDFS-9743 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux df51476d1fee 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2.7 / 7f6d150 Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 mvndep hadoop-hdfs-project_hadoop-hdfs: https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/maven-branch-dependencylist-hadoop-hdfs-project_hadoop-hdfs.txt mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/branch-mvninstall-root.txt compile https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt compile https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/branch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt mvneclipse https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/branch-mvneclipse-hadoop-hdfs-project_hadoop-hdfs.txt findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt mvndep hadoop-hdfs-project_hadoop-hdfs: https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/maven-patch-dependencylist-hadoop-hdfs-project_hadoop-hdfs.txt mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs.txt compile https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt javac https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt compile https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt javac https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt mvnsite https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt mvneclipse https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-mvneclipse-hadoop-hdfs-project_hadoop-hdfs.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/whitespace-eol.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/whitespace-tabs.txt findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt javadoc https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14348/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14348/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Max memory used 45MB Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14348/console This message was automatically generated.
        Hide
        kihwal Kihwal Lee added a comment -

        Allen Wittenauer, the branch-2.7 specific build failed. Is it expected or is there something wrong with the docker image?

        [WARNING] [protoc, --version] failed: java.io.IOException: Cannot run program "protoc": error=2, No such file or directory
        [ERROR] stdout: []
        

        We are also not pushing 2.7.3-SNAPSHOT artifacts.

        Show
        kihwal Kihwal Lee added a comment - Allen Wittenauer , the branch-2.7 specific build failed. Is it expected or is there something wrong with the docker image? [WARNING] [protoc, --version] failed: java.io.IOException: Cannot run program "protoc": error=2, No such file or directory [ERROR] stdout: [] We are also not pushing 2.7.3-SNAPSHOT artifacts.
        Hide
        aw Allen Wittenauer added a comment -

        2.7 doesn't have a Dockerfile.

        From https://builds.apache.org/job/PreCommit-HDFS-Build/14348/console (up above):

        ERROR: Dockerfile '/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/dev-support/docker/Dockerfile' not found
        
        Show
        aw Allen Wittenauer added a comment - 2.7 doesn't have a Dockerfile. From https://builds.apache.org/job/PreCommit-HDFS-Build/14348/console (up above): ERROR: Dockerfile '/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/dev-support/docker/Dockerfile' not found
        Hide
        kihwal Kihwal Lee added a comment -

        Manually tested it working.

        Show
        kihwal Kihwal Lee added a comment - Manually tested it working.
        Hide
        daryn Daryn Sharp added a comment -

        +1 looks straightforward.

        Show
        daryn Daryn Sharp added a comment - +1 looks straightforward.
        Hide
        kihwal Kihwal Lee added a comment -

        Committed to branch-2.7. Thanks for the review, Daryn.

        Show
        kihwal Kihwal Lee added a comment - Committed to branch-2.7. Thanks for the review, Daryn.
        Hide
        vinodkv Vinod Kumar Vavilapalli added a comment -

        Closing the JIRA as part of 2.7.3 release.

        Show
        vinodkv Vinod Kumar Vavilapalli added a comment - Closing the JIRA as part of 2.7.3 release.

          People

          • Assignee:
            kihwal Kihwal Lee
            Reporter:
            kihwal Kihwal Lee
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development