Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-2092

TestStorages.testNullHandlingTypesWithProjection occasionally fail

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.11.1
    • Fix Version/s: 0.12.0, 0.11.2
    • Component/s: Unit Test
    • Labels:
      None

      Description

      TestStorages.testNullHandlingTypesWithProjection occasionally fail like below.

      testNullHandlingTypesWithProjection[3](org.apache.tajo.storage.TestStorages)  Time elapsed: 0.036 sec  <<< ERROR!
      org.apache.parquet.schema.InvalidSchemaException: A group type can not be empty. Parquet does not support empty group without leaves. Empty group: table_schema
      	at org.apache.parquet.schema.GroupType.<init>(GroupType.java:92)
      	at org.apache.parquet.schema.GroupType.<init>(GroupType.java:48)
      	at org.apache.parquet.schema.MessageType.<init>(MessageType.java:50)
      	at org.apache.tajo.storage.parquet.TajoSchemaConverter.convert(TajoSchemaConverter.java:151)
      	at org.apache.tajo.storage.parquet.TajoReadSupport.init(TajoReadSupport.java:77)
      	at org.apache.tajo.storage.thirdparty.parquet.InternalParquetRecordReader.initialize(InternalParquetRecordReader.java:170)
      	at org.apache.tajo.storage.thirdparty.parquet.ParquetReader.initReader(ParquetReader.java:161)
      	at org.apache.tajo.storage.thirdparty.parquet.ParquetReader.read(ParquetReader.java:137)
      	at org.apache.tajo.storage.parquet.ParquetScanner.next(ParquetScanner.java:91)
      	at org.apache.tajo.storage.TestStorages.testNullHandlingTypesWithProjection(TestStorages.java:653)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:497)
      	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
      	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
      	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
      	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
      	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
      	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
      	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
      	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
      	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
      	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
      	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
      	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
      	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
      	at org.junit.runners.Suite.runChild(Suite.java:128)
      	at org.junit.runners.Suite.runChild(Suite.java:27)
      	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
      	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
      	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
      	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
      	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
      	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:344)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:269)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:240)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:184)
      	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:286)
      	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:240)
      	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)
      

        Activity

        Hide
        githubbot ASF GitHub Bot added a comment -

        GitHub user jinossy opened a pull request:

        https://github.com/apache/tajo/pull/982

        TAJO-2092: TestStorages.testNullHandlingTypesWithProjection occasiona…

        …lly fail.

        You can merge this pull request into a Git repository by running:

        $ git pull https://github.com/jinossy/tajo TAJO-2092

        Alternatively you can review and apply these changes as the patch at:

        https://github.com/apache/tajo/pull/982.patch

        To close this pull request, make a commit to your master/trunk branch
        with (at least) the following in the commit message:

        This closes #982


        commit b59b9a2dfd935913d7348bc43160ac7c25708872
        Author: Jinho Kim <jhkim@apache.org>
        Date: 2016-03-17T04:55:53Z

        TAJO-2092: TestStorages.testNullHandlingTypesWithProjection occasionally fail.


        Show
        githubbot ASF GitHub Bot added a comment - GitHub user jinossy opened a pull request: https://github.com/apache/tajo/pull/982 TAJO-2092 : TestStorages.testNullHandlingTypesWithProjection occasiona… …lly fail. You can merge this pull request into a Git repository by running: $ git pull https://github.com/jinossy/tajo TAJO-2092 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/tajo/pull/982.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #982 commit b59b9a2dfd935913d7348bc43160ac7c25708872 Author: Jinho Kim <jhkim@apache.org> Date: 2016-03-17T04:55:53Z TAJO-2092 : TestStorages.testNullHandlingTypesWithProjection occasionally fail.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user jinossy commented on the pull request:

        https://github.com/apache/tajo/pull/982#issuecomment-197703547

        I've remove the NULL type in file schema

        Show
        githubbot ASF GitHub Bot added a comment - Github user jinossy commented on the pull request: https://github.com/apache/tajo/pull/982#issuecomment-197703547 I've remove the NULL type in file schema
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user jihoonson commented on the pull request:

        https://github.com/apache/tajo/pull/982#issuecomment-198163357

        +1 LGTM

        Show
        githubbot ASF GitHub Bot added a comment - Github user jihoonson commented on the pull request: https://github.com/apache/tajo/pull/982#issuecomment-198163357 +1 LGTM
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user asfgit closed the pull request at:

        https://github.com/apache/tajo/pull/982

        Show
        githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/tajo/pull/982
        Hide
        jhkim Jinho Kim added a comment -

        committed it
        Thanks

        Show
        jhkim Jinho Kim added a comment - committed it Thanks
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Tajo-master-CODEGEN-build #694 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/694/)
        TAJO-2092: TestStorages.testNullHandlingTypesWithProjection occasionally (jhkim: rev d25bec87ac0fe9c819cbcf79e823222fcdad239d)

        • CHANGES
        • tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/TestStorages.java
        • tajo-storage/tajo-storage-hdfs/src/test/resources/dataset/testVariousTypes.avsc
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Tajo-master-CODEGEN-build #694 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/694/ ) TAJO-2092 : TestStorages.testNullHandlingTypesWithProjection occasionally (jhkim: rev d25bec87ac0fe9c819cbcf79e823222fcdad239d) CHANGES tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/TestStorages.java tajo-storage/tajo-storage-hdfs/src/test/resources/dataset/testVariousTypes.avsc
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-master-build #1104 (See https://builds.apache.org/job/Tajo-master-build/1104/)
        TAJO-2092: TestStorages.testNullHandlingTypesWithProjection occasionally (jhkim: rev d25bec87ac0fe9c819cbcf79e823222fcdad239d)

        • tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/TestStorages.java
        • tajo-storage/tajo-storage-hdfs/src/test/resources/dataset/testVariousTypes.avsc
        • CHANGES
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-master-build #1104 (See https://builds.apache.org/job/Tajo-master-build/1104/ ) TAJO-2092 : TestStorages.testNullHandlingTypesWithProjection occasionally (jhkim: rev d25bec87ac0fe9c819cbcf79e823222fcdad239d) tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/TestStorages.java tajo-storage/tajo-storage-hdfs/src/test/resources/dataset/testVariousTypes.avsc CHANGES
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-0.11.2-build #182 (See https://builds.apache.org/job/Tajo-0.11.2-build/182/)
        TAJO-2092: TestStorages.testNullHandlingTypesWithProjection occasionally (jhkim: rev 191faa0fdef428bfe5febe14ea908c230e0247ab)

        • tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/TestStorages.java
        • CHANGES
        • tajo-storage/tajo-storage-hdfs/src/test/resources/dataset/testVariousTypes.avsc
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-0.11.2-build #182 (See https://builds.apache.org/job/Tajo-0.11.2-build/182/ ) TAJO-2092 : TestStorages.testNullHandlingTypesWithProjection occasionally (jhkim: rev 191faa0fdef428bfe5febe14ea908c230e0247ab) tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/TestStorages.java CHANGES tajo-storage/tajo-storage-hdfs/src/test/resources/dataset/testVariousTypes.avsc

          People

          • Assignee:
            jhkim Jinho Kim
            Reporter:
            dkhwangbo Dongkyu Hwangbo
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development