Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-936

TestStorages::testSplitable is failed occasionally.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.9.0
    • Component/s: Storage
    • Labels:
      None

      Description

      Reader initialized will read a total of 1 records.
      Jul 11, 2014 1:26:07 PM INFO: parquet.hadoop.InternalParquetRecordReader: at row 0. reading next block
      Jul 11, 2014 1:26:07 PM INFO: parquet.hadoop.InternalParquetRecordReader: block read in memory in 0 ms. row count = 1
      Jul 11, 2014 1:26:07 PM INFO: parquet.hadoop.InternalParquetRecordWriter: Flushing mem store to file. allocated memory: 34,044,142
      Jul 11, 2014 1:26:07 PM INFO: parquet.hadoop.ColumnChunkPageWriteStore: written 40,031B for [id] INT32: 10,000 values, 40,008B raw, 40,008B comp, 1 pages, encodings: [RLE, BIT_PACKED, PLAIN]
      Jul 11, 2014 1:26:07 PM INFO: parquet.hadoop.ColumnChunkPageWriteStore: written 80,031B for [age] INT64: 10,000 values, 80,008B raw, 80,008B comp, 1 pages, encodings: [RLE, BIT_PACKED, PLAIN]
      Jul 11, 2014 1:26:07 PM INFO: parquet.hadoop.ColumnChunkPageWriteStore: written 40,031B for [score] FLOAT: 10,000 values, 40,008B raw, 40,008B comp, 1 pages, encodings: [RLE, BIT_PACKED, PLAIN]
      Jul 11, 2014 1:26:07 PM INFO: parquet.hadoop.ParquetFileReader: reading another 1 footers
      Jul 11, 2014 1:26:07 PM INFO: parquet.hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 10000 records.
      Jul 11, 2014 1:26:07 PM INFO: parquet.hadoop.InternalParquetRecordReader: at row 0. reading next block
      Jul 11, 2014 1:26:07 PM INFO: parquet.hadoop.InternalParquetRecordReader: block read in memory in 0 ms. row count = 10000
      
      Results :
      
      Failed tests:   testSplitable[2](org.apache.tajo.storage.TestStorages): expected:<10000> but was:<20000>
      
      Tests run: 149, Failures: 1, Errors: 0, Skipped: 0
      
      [INFO] ------------------------------------------------------------------------
      [INFO] Reactor Summary:
      [INFO] 
      [INFO] Tajo Main ......................................... SUCCESS [4.463s]
      [INFO] Tajo Project POM .................................. SUCCESS [0.472s]
      [INFO] Tajo Maven Plugins ................................ SUCCESS [2.125s]
      [INFO] Tajo Common ....................................... SUCCESS [25.765s]
      [INFO] Tajo Algebra ...................................... SUCCESS [1.217s]
      [INFO] Tajo Catalog Common ............................... SUCCESS [4.071s]
      [INFO] Tajo Rpc .......................................... SUCCESS [20.885s]
      [INFO] Tajo Catalog Client ............................... SUCCESS [1.088s]
      [INFO] Tajo Catalog Server ............................... SUCCESS [5.372s]
      [INFO] Tajo Storage ...................................... FAILURE [41.247s]
      [INFO] Tajo Core PullServer .............................. SKIPPED
      [INFO] Tajo Client ....................................... SKIPPED
      [INFO] Tajo JDBC Driver .................................. SKIPPED
      [INFO] Tajo Core ......................................... SKIPPED
      [INFO] Tajo Catalog Drivers .............................. SKIPPED
      [INFO] Tajo Catalog ...................................... SKIPPED
      [INFO] Tajo Distribution ................................. SKIPPED
      [INFO] ------------------------------------------------------------------------
      [INFO] BUILD FAILURE
      [INFO] ------------------------------------------------------------------------
      [INFO] Total time: 1:47.736s
      [INFO] Finished at: Fri Jul 11 22:26:07 KST 2014
      [INFO] Final Memory: 63M/1155M
      [INFO] ------------------------------------------------------------
      

        Activity

        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-master-build #297 (See https://builds.apache.org/job/Tajo-master-build/297/)
        TAJO-936: TestStorages::testSplitable is failed occasionally. (jinho) (jinossy: rev aee7874faa45e3ba2eda3157683cf20111cacea5)

        • tajo-storage/src/main/java/org/apache/tajo/storage/rcfile/RCFile.java
        • tajo-storage/src/test/java/org/apache/tajo/storage/TestStorages.java
        • CHANGES
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-master-build #297 (See https://builds.apache.org/job/Tajo-master-build/297/ ) TAJO-936 : TestStorages::testSplitable is failed occasionally. (jinho) (jinossy: rev aee7874faa45e3ba2eda3157683cf20111cacea5) tajo-storage/src/main/java/org/apache/tajo/storage/rcfile/RCFile.java tajo-storage/src/test/java/org/apache/tajo/storage/TestStorages.java CHANGES
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user jinossy closed the pull request at:

        https://github.com/apache/tajo/pull/68

        Show
        githubbot ASF GitHub Bot added a comment - Github user jinossy closed the pull request at: https://github.com/apache/tajo/pull/68
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user jinossy commented on the pull request:

        https://github.com/apache/tajo/pull/68#issuecomment-48992062

        committed. Thank you for the review.

        Show
        githubbot ASF GitHub Bot added a comment - Github user jinossy commented on the pull request: https://github.com/apache/tajo/pull/68#issuecomment-48992062 committed. Thank you for the review.
        Hide
        jhkim Jinho Kim added a comment -

        committed. Thank you for the review.

        Show
        jhkim Jinho Kim added a comment - committed. Thank you for the review.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user hyunsik commented on the pull request:

        https://github.com/apache/tajo/pull/68#issuecomment-48867718

        +1

        Nice finding. Ship it!

        Show
        githubbot ASF GitHub Bot added a comment - Github user hyunsik commented on the pull request: https://github.com/apache/tajo/pull/68#issuecomment-48867718 +1 Nice finding. Ship it!
        Hide
        githubbot ASF GitHub Bot added a comment -

        GitHub user jinossy opened a pull request:

        https://github.com/apache/tajo/pull/68

        TAJO-936: TestStorages::testSplitable is failed occasionally.

        if a split end position is less than the header size, it read twice

        You can merge this pull request into a Git repository by running:

        $ git pull https://github.com/jinossy/tajo TAJO-936

        Alternatively you can review and apply these changes as the patch at:

        https://github.com/apache/tajo/pull/68.patch

        To close this pull request, make a commit to your master/trunk branch
        with (at least) the following in the commit message:

        This closes #68


        commit dc981d085619a9e205cd44cb511b8648d938f3ec
        Author: jinossy <jinossy@gmail.com>
        Date: 2014-07-11T15:18:31Z

        fixed initial sync position bug


        Show
        githubbot ASF GitHub Bot added a comment - GitHub user jinossy opened a pull request: https://github.com/apache/tajo/pull/68 TAJO-936 : TestStorages::testSplitable is failed occasionally. if a split end position is less than the header size, it read twice You can merge this pull request into a Git repository by running: $ git pull https://github.com/jinossy/tajo TAJO-936 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/tajo/pull/68.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #68 commit dc981d085619a9e205cd44cb511b8648d938f3ec Author: jinossy <jinossy@gmail.com> Date: 2014-07-11T15:18:31Z fixed initial sync position bug

          People

          • Assignee:
            jhkim Jinho Kim
            Reporter:
            hyunsik Hyunsik Choi
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development