Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10879

TestEncryptionZonesWithKMS#testReadWrite fails intermittently

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 2.7.4, 3.0.0-alpha2
    • Component/s: None
    • Labels:
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Error Message:
      Key was rolled, versions should be different. Actual: test_key@0
      
      Stack Trace:
      java.lang.AssertionError: Key was rolled, versions should be different. Actual: test_key@0
              at org.junit.Assert.fail(Assert.java:88)
              at org.junit.Assert.failEquals(Assert.java:185)
              at org.junit.Assert.assertNotEquals(Assert.java:161)
              at org.apache.hadoop.hdfs.TestEncryptionZones.testReadWrite(TestEncryptionZones.java:726)
              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
              at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.lang.reflect.Method.invoke(Method.java:606)
              at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
              at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
              at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
              at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
              at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
      

        Activity

        Hide
        xiaochen Xiao Chen added a comment -

        This is stack trace reminds me of HADOOP-12699. The conclusion there was this is by design, so improve the test similarly here.
        Had a quick search in the code, didn't find any other places checking this.

        Show
        xiaochen Xiao Chen added a comment - This is stack trace reminds me of HADOOP-12699 . The conclusion there was this is by design, so improve the test similarly here. Had a quick search in the code, didn't find any other places checking this.
        Hide
        xiaochen Xiao Chen added a comment -

        In my test run, it failed 2/300 before the patch and 0/300 after.
        Andrew Wang, could you take a look? Thanks!

        Show
        xiaochen Xiao Chen added a comment - In my test run, it failed 2/300 before the patch and 0/300 after. Andrew Wang , could you take a look? Thanks!
        Hide
        andrew.wang Andrew Wang added a comment -

        +1 LGTM, and yea definitely similar to that previous one we fixed. Thanks for the fixing this Xiao!

        Show
        andrew.wang Andrew Wang added a comment - +1 LGTM, and yea definitely similar to that previous one we fixed. Thanks for the fixing this Xiao!
        Hide
        hadoopqa Hadoop QA added a comment -
        +1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 17s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        +1 mvninstall 7m 16s trunk passed
        +1 compile 0m 46s trunk passed
        +1 checkstyle 0m 27s trunk passed
        +1 mvnsite 0m 58s trunk passed
        +1 mvneclipse 0m 12s trunk passed
        +1 findbugs 1m 47s trunk passed
        +1 javadoc 0m 56s trunk passed
        +1 mvninstall 0m 50s the patch passed
        +1 compile 0m 45s the patch passed
        +1 javac 0m 45s the patch passed
        +1 checkstyle 0m 24s the patch passed
        +1 mvnsite 0m 51s the patch passed
        +1 mvneclipse 0m 9s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 1m 52s the patch passed
        +1 javadoc 0m 54s the patch passed
        +1 unit 59m 15s hadoop-hdfs in the patch passed.
        +1 asflicense 0m 18s The patch does not generate ASF License warnings.
        79m 13s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Issue HDFS-10879
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12829449/HDFS-10879.01.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 2698ab06aeab 3.13.0-92-generic #139-Ubuntu SMP Tue Jun 28 20:42:26 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / e80386d
        Default Java 1.8.0_101
        findbugs v3.0.0
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/16813/testReport/
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/16813/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 17s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 7m 16s trunk passed +1 compile 0m 46s trunk passed +1 checkstyle 0m 27s trunk passed +1 mvnsite 0m 58s trunk passed +1 mvneclipse 0m 12s trunk passed +1 findbugs 1m 47s trunk passed +1 javadoc 0m 56s trunk passed +1 mvninstall 0m 50s the patch passed +1 compile 0m 45s the patch passed +1 javac 0m 45s the patch passed +1 checkstyle 0m 24s the patch passed +1 mvnsite 0m 51s the patch passed +1 mvneclipse 0m 9s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 52s the patch passed +1 javadoc 0m 54s the patch passed +1 unit 59m 15s hadoop-hdfs in the patch passed. +1 asflicense 0m 18s The patch does not generate ASF License warnings. 79m 13s Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Issue HDFS-10879 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12829449/HDFS-10879.01.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 2698ab06aeab 3.13.0-92-generic #139-Ubuntu SMP Tue Jun 28 20:42:26 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / e80386d Default Java 1.8.0_101 findbugs v3.0.0 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/16813/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Console output https://builds.apache.org/job/PreCommit-HDFS-Build/16813/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        xiaochen Xiao Chen added a comment -

        Committed this to trunk, branch-2 and branch-2.8. Thanks Andrew for the prompt review!

        Show
        xiaochen Xiao Chen added a comment - Committed this to trunk, branch-2 and branch-2.8. Thanks Andrew for the prompt review!
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10470 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10470/)
        HDFS-10879. TestEncryptionZonesWithKMS#testReadWrite fails (xiao: rev 0e918dff594e9ba5434fdee7fc1f6394b62b32cd)

        • (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestEncryptionZones.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10470 (See https://builds.apache.org/job/Hadoop-trunk-Commit/10470/ ) HDFS-10879 . TestEncryptionZonesWithKMS#testReadWrite fails (xiao: rev 0e918dff594e9ba5434fdee7fc1f6394b62b32cd) (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestEncryptionZones.java
        Hide
        zhz Zhe Zhang added a comment -

        Thanks Xiao for the fix. I think this is relevant to branch-2.7 and just did the backport.

        Show
        zhz Zhe Zhang added a comment - Thanks Xiao for the fix. I think this is relevant to branch-2.7 and just did the backport.

          People

          • Assignee:
            xiaochen Xiao Chen
            Reporter:
            xiaochen Xiao Chen
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development