Hadoop Common
  1. Hadoop Common
  2. HADOOP-10510

TestSymlinkLocalFSFileContext tests are failing

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Duplicate
    • Affects Version/s: 2.4.0
    • Fix Version/s: None
    • Component/s: fs
    • Labels:
      None
    • Environment:

      Linux

      Description

      Test results:
      https://gist.github.com/oza/9965197

      This was mentioned on hadoop-common-dev:
      http://mail-archives.apache.org/mod_mbox/hadoop-common-dev/201404.mbox/%3CCAAD07OKRSmx9VSjmfk1YxyBmnFM8mwZSp%3DizP8yKKwoXYvn3Qg%40mail.gmail.com%3E

      Can you suggest a workaround in the meantime? I'd like to send a pull request for an unrelated bug, but these failures mean I cannot build hadoop-common to test my fix. Thanks.

        Issue Links

          Activity

          Hide
          Colin Patrick McCabe added a comment -

          I don't think using gist here is a good practice, since if that site ever goes down (or removes your particular entry), we will be left wondering what this bug is about. Can you add the relevant information to JIRA? Thanks.

          Show
          Colin Patrick McCabe added a comment - I don't think using gist here is a good practice, since if that site ever goes down (or removes your particular entry), we will be left wondering what this bug is about. Can you add the relevant information to JIRA? Thanks.
          Hide
          Tsuyoshi Ozawa added a comment -

          Hi Colin, thank you for pointing! The following log is a result of the test failure:

          Results :

          Failed tests:
          TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testStatDanglingLink:115->SymlinkBaseTest.testStatDanglingLink:301 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testStatLinkToFile:244 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testStatLinkToDir:286 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingRelPaths:447->SymlinkBaseTest.checkLink:381 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingAbsPaths:472->SymlinkBaseTest.checkLink:381 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingFullyQualPaths:503->SymlinkBaseTest.checkLink:381 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDirectory:627 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkViaLink:679 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkViaSymlink:897 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkNonExistantDest:1036 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkToExistingFile:1063 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlink:1134 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testStatLinkToFile:244 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testStatLinkToDir:286 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingRelPaths:447->SymlinkBaseTest.checkLink:381 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingAbsPaths:472->SymlinkBaseTest.checkLink:381 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingFullyQualPaths:503->SymlinkBaseTest.checkLink:381 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDirectory:627 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkViaLink:679 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkViaSymlink:897 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkNonExistantDest:1036 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkToExistingFile:1063 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlink:1134 null
          TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testStatDanglingLink:115->SymlinkBaseTest.testStatDanglingLink:301 null

          Tests in error:
          TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testDanglingLink:163 ? IO Path...
          TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 ? IO
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 ? IO
          TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testDanglingLink:163 ? IO Pat...
          TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 ? IO
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 ? IO

          Show
          Tsuyoshi Ozawa added a comment - Hi Colin, thank you for pointing! The following log is a result of the test failure: Results : Failed tests: TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testStatDanglingLink:115->SymlinkBaseTest.testStatDanglingLink:301 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testStatLinkToFile:244 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testStatLinkToDir:286 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingRelPaths:447->SymlinkBaseTest.checkLink:381 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingAbsPaths:472->SymlinkBaseTest.checkLink:381 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingFullyQualPaths:503->SymlinkBaseTest.checkLink:381 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDirectory:627 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkViaLink:679 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkViaSymlink:897 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkNonExistantDest:1036 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkToExistingFile:1063 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlink:1134 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testStatLinkToFile:244 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testStatLinkToDir:286 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingRelPaths:447->SymlinkBaseTest.checkLink:381 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingAbsPaths:472->SymlinkBaseTest.checkLink:381 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingFullyQualPaths:503->SymlinkBaseTest.checkLink:381 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDirectory:627 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkViaLink:679 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkViaSymlink:897 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkNonExistantDest:1036 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkToExistingFile:1063 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlink:1134 null TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testStatDanglingLink:115->SymlinkBaseTest.testStatDanglingLink:301 null Tests in error: TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testDanglingLink:163 ? IO Path... TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 ? IO TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 ? IO TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testDanglingLink:163 ? IO Pat... TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 ? IO TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 ? IO
          Hide
          Colin Patrick McCabe added a comment -

          That's a very odd error message. Just "null"? Have you tried a clean rebuild, or running the tests on their own to get a more informative message?

          Show
          Colin Patrick McCabe added a comment - That's a very odd error message. Just "null"? Have you tried a clean rebuild, or running the tests on their own to get a more informative message?
          Hide
          Tsuyoshi Ozawa added a comment -

          Attached full log of result of "mvn clean test -Dtest=TestSymlinkLocalFSFileContext".

          Show
          Tsuyoshi Ozawa added a comment - Attached full log of result of "mvn clean test -Dtest=TestSymlinkLocalFSFileContext".
          Hide
          Andrew Wang added a comment -

          I ran these successfully myself, so not sure what's going on. My -output.txt also shows the same two ln failures, so those are probably not the root cause.

          Could you add info about your JVM and OS version? It might also help to figure out which is the first of these tests to fail.

          It's also kind of weird that the line numbers in the comment don't line up with the contents of SymlinkBaseTest.java. That file hasn't been touched in a long time, so I suspect your build folder isn't clean. Try a git clean -xdf or fresh checkout.

          Show
          Andrew Wang added a comment - I ran these successfully myself, so not sure what's going on. My -output.txt also shows the same two ln failures, so those are probably not the root cause. Could you add info about your JVM and OS version? It might also help to figure out which is the first of these tests to fail. It's also kind of weird that the line numbers in the comment don't line up with the contents of SymlinkBaseTest.java. That file hasn't been touched in a long time, so I suspect your build folder isn't clean. Try a git clean -xdf or fresh checkout.
          Hide
          Tsuyoshi Ozawa added a comment -

          Thanks for your comment, Andrew. I can reproduce the issue after executing git clean -xdf. I also confirmed the disk is not full. JVM and OS version are as follows:

          $ uname -a
          Linux ip-172-31-7-130 3.11.0-15-generic #25-Ubuntu SMP Thu Jan 30 17:22:01 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          
          $ java -version
          java version "1.7.0_51"
          Java(TM) SE Runtime Environment (build 1.7.0_51-b13)
          Java HotSpot(TM) 64-Bit Server VM (build 24.51-b03, mixed mode)
          

          Environment variable:

          export LANG=C
          export LC_ALL=C
          export HADOOP_COMMON_HOME=~/hadoop
          export HADOOP_HDFS_HOME=/home/ubuntu/hadoop
          export HADOOP_MAPRED_HOME=/home/ubuntu/hadoop
          export HADOOP_CONF_DIR=/home/ubuntu/hadoop/etc/hadoop
          export TEZ_CONF_DIR=/home/ubuntu/hadoop/etc/hadoop
          export TEZ_JARS=~/tez 
          export LD_LIBRARY_PATH=/usr/local/lib
          export LD_RUN_PATH=/usr/local/lib
          
          $ echo $JAVA_HOME
          /usr/lib/jvm/java-7-oracle
          

          I'm using c4.xlarge instance of AWS with Ubuntu Server 13.10 (PV) - ami-21077220 (64-bit).

          Show
          Tsuyoshi Ozawa added a comment - Thanks for your comment, Andrew. I can reproduce the issue after executing git clean -xdf . I also confirmed the disk is not full. JVM and OS version are as follows: $ uname -a Linux ip-172-31-7-130 3.11.0-15- generic #25-Ubuntu SMP Thu Jan 30 17:22:01 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux $ java -version java version "1.7.0_51" Java(TM) SE Runtime Environment (build 1.7.0_51-b13) Java HotSpot(TM) 64-Bit Server VM (build 24.51-b03, mixed mode) Environment variable: export LANG=C export LC_ALL=C export HADOOP_COMMON_HOME=~/hadoop export HADOOP_HDFS_HOME=/home/ubuntu/hadoop export HADOOP_MAPRED_HOME=/home/ubuntu/hadoop export HADOOP_CONF_DIR=/home/ubuntu/hadoop/etc/hadoop export TEZ_CONF_DIR=/home/ubuntu/hadoop/etc/hadoop export TEZ_JARS=~/tez export LD_LIBRARY_PATH=/usr/local/lib export LD_RUN_PATH=/usr/local/lib $ echo $JAVA_HOME /usr/lib/jvm/java-7-oracle I'm using c4.xlarge instance of AWS with Ubuntu Server 13.10 (PV) - ami-21077220 (64-bit).
          Hide
          Daniel Darabos added a comment -

          For another data point here's mine.

          $ git clone https://github.com/apache/hadoop-common.git
          Cloning into 'hadoop-common'...
          remote: Reusing existing pack: 581936, done.
          remote: Counting objects: 281, done.
          remote: Compressing objects: 100% (221/221), done.
          remote: Total 582217 (delta 90), reused 27 (delta 7)
          Receiving objects: 100% (582217/582217), 326.30 MiB | 3.42 MiB/s, done.
          Resolving deltas: 100% (304783/304783), done.
          Checking connectivity... done.
          $ cd hadoop-common/
          $ mvn package
          [...lot of stuff...]
          Running org.apache.hadoop.fs.TestSymlinkLocalFSFileContext
          Tests run: 61, Failures: 12, Errors: 3, Skipped: 3, Time elapsed: 1.7 sec <<< FAILURE! - in org.apache.hadoop.fs.TestSymlinkLocalFSFileContext
          testDanglingLink(org.apache.hadoop.fs.TestSymlinkLocalFSFileContext)  Time elapsed: 0.034 sec  <<< ERROR!
          java.io.IOException: Path file:/home/darabos/c/hadoop-common/hadoop-common-project/hadoop-common/target/test/data/Ls5xoGQ7Nz/test1/linkToFile is not a symbolic link
          	at org.apache.hadoop.fs.FileStatus.getSymlink(FileStatus.java:251)
          	at org.apache.hadoop.fs.TestSymlinkLocalFS.testDanglingLink(TestSymlinkLocalFS.java:163)
          	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
          	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          	at java.lang.reflect.Method.invoke(Method.java:606)
          	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
          	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
          	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
          	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
          	at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
          
          testGetLinkStatusPartQualTarget(org.apache.hadoop.fs.TestSymlinkLocalFSFileContext)  Time elapsed: 0.032 sec  <<< ERROR!
          java.io.IOException: Path file:/home/darabos/c/hadoop-common/hadoop-common-project/hadoop-common/target/test/data/Ls5xoGQ7Nz/test1/linkToFile is not a symbolic link
          	at org.apache.hadoop.fs.FileStatus.getSymlink(FileStatus.java:251)
          	at org.apache.hadoop.fs.TestSymlinkLocalFS.testGetLinkStatusPartQualTarget(TestSymlinkLocalFS.java:201)
          	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
          	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          	at java.lang.reflect.Method.invoke(Method.java:606)
          	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
          	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
          	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
          	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
          	at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
          
          testCreateLinkUsingRelPaths(org.apache.hadoop.fs.TestSymlinkLocalFSFileContext)  Time elapsed: 0.028 sec  <<< FAILURE!
          java.lang.AssertionError: null
          	at org.junit.Assert.fail(Assert.java:86)
          	at org.junit.Assert.assertTrue(Assert.java:41)
          	at org.junit.Assert.assertTrue(Assert.java:52)
          	at org.apache.hadoop.fs.SymlinkBaseTest.checkLink(SymlinkBaseTest.java:377)
          	at org.apache.hadoop.fs.SymlinkBaseTest.testCreateLinkUsingRelPaths(SymlinkBaseTest.java:443)
          	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
          	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          	at java.lang.reflect.Method.invoke(Method.java:606)
          	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
          	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
          	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
          	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
          	at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
          [...more errors and failures...]
          Running org.apache.hadoop.fs.TestSymlinkLocalFSFileSystem
          Tests run: 61, Failures: 12, Errors: 3, Skipped: 7, Time elapsed: 1.553 sec <<< FAILURE! - in org.apache.hadoop.fs.TestSymlinkLocalFSFileSystem
          [...stack traces here as well...]
          Results :
          
          Failed tests: 
            TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingRelPaths:443->SymlinkBaseTest.checkLink:377 null
            TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingFullyQualPaths:499->SymlinkBaseTest.checkLink:377 null
            TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkToExistingFile:1059 null
            TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testStatDanglingLink:115->SymlinkBaseTest.testStatDanglingLink:297 null
            TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkNonExistantDest:1032 null
            TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDirectory:623 null
            TestSymlinkLocalFSFileContext>SymlinkBaseTest.testStatLinkToDir:282 null
            TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkViaLink:675 null
            TestSymlinkLocalFSFileContext>SymlinkBaseTest.testStatLinkToFile:240 null
            TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingAbsPaths:468->SymlinkBaseTest.checkLink:377 null
            TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkViaSymlink:893 null
            TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlink:1130 null
            TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingRelPaths:443->SymlinkBaseTest.checkLink:377 null
            TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingFullyQualPaths:499->SymlinkBaseTest.checkLink:377 null
            TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkToExistingFile:1059 null
            TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testStatDanglingLink:115->SymlinkBaseTest.testStatDanglingLink:297 null
            TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkNonExistantDest:1032 null
            TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDirectory:623 null
            TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testStatLinkToDir:282 null
            TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkViaLink:675 null
            TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testStatLinkToFile:240 null
            TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingAbsPaths:468->SymlinkBaseTest.checkLink:377 null
            TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkViaSymlink:893 null
            TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlink:1130 null
          
          Tests in error: 
            TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testDanglingLink:163 » IO Pat...
            TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 » IO
            TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDotDotPrefix:818 » IO
            TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testDanglingLink:163 » IO Path...
            TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 » IO
            TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDotDotPrefix:818 » IO
          
          Tests run: 2369, Failures: 24, Errors: 6, Skipped: 106
          

          OS and JVM:

          $ uname -a
          Linux ramhegy 3.13.0-24-generic #46-Ubuntu SMP Thu Apr 10 19:11:08 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          $ java -version
          java version "1.7.0_51"
          OpenJDK Runtime Environment (IcedTea 2.4.6) (7u51-2.4.6-1ubuntu4)
          OpenJDK 64-Bit Server VM (build 24.51-b03, mixed mode)
          
          Show
          Daniel Darabos added a comment - For another data point here's mine. $ git clone https: //github.com/apache/hadoop-common.git Cloning into 'hadoop-common'... remote: Reusing existing pack: 581936, done. remote: Counting objects: 281, done. remote: Compressing objects: 100% (221/221), done. remote: Total 582217 (delta 90), reused 27 (delta 7) Receiving objects: 100% (582217/582217), 326.30 MiB | 3.42 MiB/s, done. Resolving deltas: 100% (304783/304783), done. Checking connectivity... done. $ cd hadoop-common/ $ mvn package [...lot of stuff...] Running org.apache.hadoop.fs.TestSymlinkLocalFSFileContext Tests run: 61, Failures: 12, Errors: 3, Skipped: 3, Time elapsed: 1.7 sec <<< FAILURE! - in org.apache.hadoop.fs.TestSymlinkLocalFSFileContext testDanglingLink(org.apache.hadoop.fs.TestSymlinkLocalFSFileContext) Time elapsed: 0.034 sec <<< ERROR! java.io.IOException: Path file:/home/darabos/c/hadoop-common/hadoop-common-project/hadoop-common/target/test/data/Ls5xoGQ7Nz/test1/linkToFile is not a symbolic link at org.apache.hadoop.fs.FileStatus.getSymlink(FileStatus.java:251) at org.apache.hadoop.fs.TestSymlinkLocalFS.testDanglingLink(TestSymlinkLocalFS.java:163) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74) testGetLinkStatusPartQualTarget(org.apache.hadoop.fs.TestSymlinkLocalFSFileContext) Time elapsed: 0.032 sec <<< ERROR! java.io.IOException: Path file:/home/darabos/c/hadoop-common/hadoop-common-project/hadoop-common/target/test/data/Ls5xoGQ7Nz/test1/linkToFile is not a symbolic link at org.apache.hadoop.fs.FileStatus.getSymlink(FileStatus.java:251) at org.apache.hadoop.fs.TestSymlinkLocalFS.testGetLinkStatusPartQualTarget(TestSymlinkLocalFS.java:201) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74) testCreateLinkUsingRelPaths(org.apache.hadoop.fs.TestSymlinkLocalFSFileContext) Time elapsed: 0.028 sec <<< FAILURE! java.lang.AssertionError: null at org.junit.Assert.fail(Assert.java:86) at org.junit.Assert.assertTrue(Assert.java:41) at org.junit.Assert.assertTrue(Assert.java:52) at org.apache.hadoop.fs.SymlinkBaseTest.checkLink(SymlinkBaseTest.java:377) at org.apache.hadoop.fs.SymlinkBaseTest.testCreateLinkUsingRelPaths(SymlinkBaseTest.java:443) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74) [...more errors and failures...] Running org.apache.hadoop.fs.TestSymlinkLocalFSFileSystem Tests run: 61, Failures: 12, Errors: 3, Skipped: 7, Time elapsed: 1.553 sec <<< FAILURE! - in org.apache.hadoop.fs.TestSymlinkLocalFSFileSystem [...stack traces here as well...] Results : Failed tests: TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingRelPaths:443->SymlinkBaseTest.checkLink:377 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingFullyQualPaths:499->SymlinkBaseTest.checkLink:377 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkToExistingFile:1059 null TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testStatDanglingLink:115->SymlinkBaseTest.testStatDanglingLink:297 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkNonExistantDest:1032 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDirectory:623 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testStatLinkToDir:282 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkViaLink:675 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testStatLinkToFile:240 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingAbsPaths:468->SymlinkBaseTest.checkLink:377 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkViaSymlink:893 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlink:1130 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingRelPaths:443->SymlinkBaseTest.checkLink:377 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingFullyQualPaths:499->SymlinkBaseTest.checkLink:377 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkToExistingFile:1059 null TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testStatDanglingLink:115->SymlinkBaseTest.testStatDanglingLink:297 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkNonExistantDest:1032 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDirectory:623 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testStatLinkToDir:282 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkViaLink:675 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testStatLinkToFile:240 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingAbsPaths:468->SymlinkBaseTest.checkLink:377 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkViaSymlink:893 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlink:1130 null Tests in error: TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testDanglingLink:163 » IO Pat... TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 » IO TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDotDotPrefix:818 » IO TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testDanglingLink:163 » IO Path... TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 » IO TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDotDotPrefix:818 » IO Tests run: 2369, Failures: 24, Errors: 6, Skipped: 106 OS and JVM: $ uname -a Linux ramhegy 3.13.0-24- generic #46-Ubuntu SMP Thu Apr 10 19:11:08 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux $ java -version java version "1.7.0_51" OpenJDK Runtime Environment (IcedTea 2.4.6) (7u51-2.4.6-1ubuntu4) OpenJDK 64-Bit Server VM (build 24.51-b03, mixed mode)
          Hide
          Killua Huang added a comment -

          I think this issue should be fixed. I got similarly failure when I ran tests. Here is mine:

          Failed tests:
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testStatLinkToFile:244 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testStatLinkToDir:286 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingRelPaths:447->SymlinkBaseTest.checkLink:381 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingAbsPaths:472->SymlinkBaseTest.checkLink:381 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingFullyQualPaths:503->SymlinkBaseTest.checkLink:381 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDirectory:627 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkViaLink:679 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkViaSymlink:897 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkNonExistantDest:1036 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkToExistingFile:1063 null
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlink:1134 null
          TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testStatDanglingLink:115->SymlinkBaseTest.testStatDanglingLink:301 null
          TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testStatDanglingLink:115->SymlinkBaseTest.testStatDanglingLink:301 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testStatLinkToFile:244 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testStatLinkToDir:286 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingRelPaths:447->SymlinkBaseTest.checkLink:381 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingAbsPaths:472->SymlinkBaseTest.checkLink:381 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingFullyQualPaths:503->SymlinkBaseTest.checkLink:381 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDirectory:627 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkViaLink:679 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkViaSymlink:897 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkNonExistantDest:1036 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkToExistingFile:1063 null
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlink:1134 null

          Tests in error:
          TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testDanglingLink:163 » IO Pat...
          TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 » IO
          TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 » IO
          TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 » IO
          TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testDanglingLink:163 » IO Path...
          TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 » IO

          Show
          Killua Huang added a comment - I think this issue should be fixed. I got similarly failure when I ran tests. Here is mine: Failed tests: TestSymlinkLocalFSFileContext>SymlinkBaseTest.testStatLinkToFile:244 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testStatLinkToDir:286 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingRelPaths:447->SymlinkBaseTest.checkLink:381 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingAbsPaths:472->SymlinkBaseTest.checkLink:381 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingFullyQualPaths:503->SymlinkBaseTest.checkLink:381 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDirectory:627 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkViaLink:679 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkViaSymlink:897 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkNonExistantDest:1036 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkToExistingFile:1063 null TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlink:1134 null TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testStatDanglingLink:115->SymlinkBaseTest.testStatDanglingLink:301 null TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testStatDanglingLink:115->SymlinkBaseTest.testStatDanglingLink:301 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testStatLinkToFile:244 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testStatLinkToDir:286 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingRelPaths:447->SymlinkBaseTest.checkLink:381 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingAbsPaths:472->SymlinkBaseTest.checkLink:381 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingFullyQualPaths:503->SymlinkBaseTest.checkLink:381 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDirectory:627 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkViaLink:679 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkViaSymlink:897 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkNonExistantDest:1036 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkToExistingFile:1063 null TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlink:1134 null Tests in error: TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testDanglingLink:163 » IO Pat... TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 » IO TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 » IO TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201 » IO TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testDanglingLink:163 » IO Path... TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822 » IO
          Hide
          Carlos Mundi added a comment -

          I confirm this test failure occurs when building from the RELEASED 2.4.0 source tarball. We would rather not skip tests...

          $ uname -a
          Linux space 3.11-2-amd64 #1 SMP Debian 3.11.8-1 (2013-11-13) x86_64 GNU/Linux
          $ java -version
          java version "1.7.0_21"
          OpenJDK Runtime Environment (IcedTea 2.3.9) (7u21-2.3.9-5)
          OpenJDK 64-Bit Server VM (build 23.7-b01, mixed mode)

          Show
          Carlos Mundi added a comment - I confirm this test failure occurs when building from the RELEASED 2.4.0 source tarball. We would rather not skip tests... $ uname -a Linux space 3.11-2-amd64 #1 SMP Debian 3.11.8-1 (2013-11-13) x86_64 GNU/Linux $ java -version java version "1.7.0_21" OpenJDK Runtime Environment (IcedTea 2.3.9) (7u21-2.3.9-5) OpenJDK 64-Bit Server VM (build 23.7-b01, mixed mode)
          Hide
          Yongjun Zhang added a comment -

          I'm marking this as a duplicate per Andrew Wang's comments in HADOOP-10866. Thanks to you all!

          Show
          Yongjun Zhang added a comment - I'm marking this as a duplicate per Andrew Wang 's comments in HADOOP-10866 . Thanks to you all!

            People

            • Assignee:
              Unassigned
              Reporter:
              Daniel Darabos
            • Votes:
              2 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development