Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3754

TestParquet.test_corrupt_rle_counts fails

    Details

      Description

      The repeated runs test job fails saying

      Error Message
      
      query_test/test_scanners.py:249: in test_corrupt_rle_counts     vector, unique_database) common/impala_test_suite.py:299: in run_test_case     self.__verify_exceptions(test_section['CATCH'], str(e), use_db) common/impala_test_suite.py:209: in __verify_exceptions     assert False, 'Unexpected exception string: %s' % actual_str E   AssertionError: Unexpected exception string: ImpalaBeeswaxException: Query aborted:File 'hdfs://localhost:20500/test-warehouse/test_corrupt_rle_counts_fe183a42.db/bad_rle_counts/bad_rle_literal_count.parquet' is corrupt: error decoding dictionary-encoded value of type BIGINT at offset 69File 'hdfs://localhost:20500/test-warehouse/test_corrupt_rle_counts_fe183a42.db/bad_rle_counts/bad_rle_literal_count.parquet' is corrupt: error decoding dictionary-encoded value of type BIGINT at offset 69
      Stacktrace
      
      query_test/test_scanners.py:249: in test_corrupt_rle_counts
          vector, unique_database)
      common/impala_test_suite.py:299: in run_test_case
          self.__verify_exceptions(test_section['CATCH'], str(e), use_db)
      common/impala_test_suite.py:209: in __verify_exceptions
          assert False, 'Unexpected exception string: %s' % actual_str
      E   AssertionError: Unexpected exception string: ImpalaBeeswaxException: Query aborted:File 'hdfs://localhost:20500/test-warehouse/test_corrupt_rle_counts_fe183a42.db/bad_rle_counts/bad_rle_literal_count.parquet' is corrupt: error decoding dictionary-encoded value of type BIGINT at offset 69File 'hdfs://localhost:20500/test-warehouse/test_corrupt_rle_counts_fe183a42.db/bad_rle_counts/bad_rle_literal_count.parquet' is corrupt: error decoding dictionary-encoded value of type BIGINT at offset 69
      Standard Error
      
      -- executing against localhost:21000
      DROP DATABASE IF EXISTS `test_corrupt_rle_counts_fe183a42` CASCADE;
      
      -- executing against localhost:21000
      CREATE DATABASE `test_corrupt_rle_counts_fe183a42`;
      
      MainThread: Created database "test_corrupt_rle_counts_fe183a42" for test ID "query_test/test_scanners.py::TestParquet::()::test_corrupt_rle_counts[exec_option: {'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0, 'batch_size': 0, 'num_nodes': 0} | table_format: parquet/none]"
      -- executing against localhost:21000
      create table test_corrupt_rle_counts_fe183a42.bad_rle_counts (c bigint) stored as parquet;
      
      -- executing against localhost:21000
      use test_corrupt_rle_counts_fe183a42;
      
      SET disable_codegen=False;
      SET abort_on_error=0;
      SET exec_single_node_rows_threshold=0;
      SET batch_size=0;
      SET num_nodes=0;
      -- executing against localhost:21000
      select * from bad_rle_counts;
      
      -- executing against localhost:21000
      use test_corrupt_rle_counts_fe183a42;
      
      SET disable_codegen=False;
      SET abort_on_error=1;
      SET exec_single_node_rows_threshold=0;
      SET batch_size=0;
      SET num_nodes=0;
      -- executing against localhost:21000
      select * from bad_rle_counts;
      

      I'm guessing this is related to https://github.com/cloudera/Impala/commit/11df0d00877e864b15f76cc4ac664af06da95a25

      The failed job is http://sandbox.jenkins.cloudera.com/job/impala-cdh5-trunk-core-repeated-runs/583/testReport/junit/query_test.test_scanners/TestParquet/test_corrupt_rle_counts_exec_option____disable_codegen___False___abort_on_error___1___exec_single_node_rows_threshold___0___batch_size___0___num_nodes___0____table_format__parquet_none_/

        Attachments

          Activity

            People

            • Assignee:
              tarmstrong Tim Armstrong
              Reporter:
              caseyc casey
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: