[IMPALA-3754] TestParquet.test_corrupt_rle_counts fails

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 2.7.0
• Fix Version/s: Impala 2.7.0, Impala 2.5.2, Impala 2.6.2
• Component/s: Backend
• Labels: broken-build
• Target Version: Impala 2.7.0, Impala 2.5.2, Impala 2.6.2
• Assignee: Tim Armstrong
• Reporter: casey
• Created: 16/Jun/16 21:02
• Updated: 08/Sep/16 16:22
• Resolved: 20/Jun/16 05:57

Description

The repeated runs test job fails saying

Error Message

query_test/test_scanners.py:249: in test_corrupt_rle_counts     vector, unique_database) common/impala_test_suite.py:299: in run_test_case     self.__verify_exceptions(test_section['CATCH'], str(e), use_db) common/impala_test_suite.py:209: in __verify_exceptions     assert False, 'Unexpected exception string: %s' % actual_str E   AssertionError: Unexpected exception string: ImpalaBeeswaxException: Query aborted:File 'hdfs://localhost:20500/test-warehouse/test_corrupt_rle_counts_fe183a42.db/bad_rle_counts/bad_rle_literal_count.parquet' is corrupt: error decoding dictionary-encoded value of type BIGINT at offset 69File 'hdfs://localhost:20500/test-warehouse/test_corrupt_rle_counts_fe183a42.db/bad_rle_counts/bad_rle_literal_count.parquet' is corrupt: error decoding dictionary-encoded value of type BIGINT at offset 69
Stacktrace

query_test/test_scanners.py:249: in test_corrupt_rle_counts
    vector, unique_database)
common/impala_test_suite.py:299: in run_test_case
    self.__verify_exceptions(test_section['CATCH'], str(e), use_db)
common/impala_test_suite.py:209: in __verify_exceptions
    assert False, 'Unexpected exception string: %s' % actual_str
E   AssertionError: Unexpected exception string: ImpalaBeeswaxException: Query aborted:File 'hdfs://localhost:20500/test-warehouse/test_corrupt_rle_counts_fe183a42.db/bad_rle_counts/bad_rle_literal_count.parquet' is corrupt: error decoding dictionary-encoded value of type BIGINT at offset 69File 'hdfs://localhost:20500/test-warehouse/test_corrupt_rle_counts_fe183a42.db/bad_rle_counts/bad_rle_literal_count.parquet' is corrupt: error decoding dictionary-encoded value of type BIGINT at offset 69
Standard Error

-- executing against localhost:21000
DROP DATABASE IF EXISTS `test_corrupt_rle_counts_fe183a42` CASCADE;

-- executing against localhost:21000
CREATE DATABASE `test_corrupt_rle_counts_fe183a42`;

MainThread: Created database "test_corrupt_rle_counts_fe183a42" for test ID "query_test/test_scanners.py::TestParquet::()::test_corrupt_rle_counts[exec_option: {'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0, 'batch_size': 0, 'num_nodes': 0} | table_format: parquet/none]"
-- executing against localhost:21000
create table test_corrupt_rle_counts_fe183a42.bad_rle_counts (c bigint) stored as parquet;

-- executing against localhost:21000
use test_corrupt_rle_counts_fe183a42;

SET disable_codegen=False;
SET abort_on_error=0;
SET exec_single_node_rows_threshold=0;
SET batch_size=0;
SET num_nodes=0;
-- executing against localhost:21000
select * from bad_rle_counts;

-- executing against localhost:21000
use test_corrupt_rle_counts_fe183a42;

SET disable_codegen=False;
SET abort_on_error=1;
SET exec_single_node_rows_threshold=0;
SET batch_size=0;
SET num_nodes=0;
-- executing against localhost:21000
select * from bad_rle_counts;

I'm guessing this is related to https://github.com/cloudera/Impala/commit/11df0d00877e864b15f76cc4ac664af06da95a25

The failed job is http://sandbox.jenkins.cloudera.com/job/impala-cdh5-trunk-core-repeated-runs/583/testReport/junit/query_test.test_scanners/TestParquet/test_corrupt_rle_counts_exec_option____disable_codegen___False___abort_on_error___1___exec_single_node_rows_threshold___0___batch_size___0___num_nodes___0____table_format__parquet_none_/