[IMPALA-7335] Assertion Failure - test_corrupt_files

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 3.1.0
• Fix Version/s: Impala 3.1.0
• Labels: broken-build
• Target Version: Impala 3.1.0
• Epic Color: ghx-label-3
• Assignee: Pooja Nilangekar
• Reporter: nithya
• Created: 23/Jul/18 17:42
• Updated: 27/Oct/18 05:19
• Resolved: 21/Sep/18 16:27

Description

test_corrupt_files fails 

 

query_test.test_scanners.TestParquet.test_corrupt_files[exec_option:

{'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'abort_on_error': 1, 'debug_action': None, 'exec_single_node_rows_threshold': 0}

| table_format: parquet/none] (from pytest)

 

Error Message

query_test/test_scanners.py:300: in test_corrupt_files     self.run_test_case('QueryTest/parquet-abort-on-error', vector) common/impala_test_suite.py:420: in run_test_case     assert False, "Expected exception: %s" % expected_str E   AssertionError: Expected exception: Column metadata states there are 11 values, but read 10 values from column id.

STACKTRACE

query_test/test_scanners.py:300: in test_corrupt_files
    self.run_test_case('QueryTest/parquet-abort-on-error', vector)
common/impala_test_suite.py:420: in run_test_case
    assert False, "Expected exception: %s" % expected_str
E   AssertionError: Expected exception: Column metadata states there are 11 values, but read 10 values from column id.


Standard Error

-- executing against localhost:21000
use functional_parquet;

SET batch_size=0;
SET num_nodes=0;
SET disable_codegen_rows_threshold=0;
SET disable_codegen=False;
SET abort_on_error=0;
SET exec_single_node_rows_threshold=0;
-- executing against localhost:21000
set num_nodes=1;

-- executing against localhost:21000

set num_scanner_threads=1;

-- executing against localhost:21000

select id, cnt from bad_column_metadata t, (select count(*) cnt from t.int_array) v;

-- executing against localhost:21000
SET NUM_NODES="0";

-- executing against localhost:21000
SET NUM_SCANNER_THREADS="0";

-- executing against localhost:21000
set num_nodes=1;

-- executing against localhost:21000

set num_scanner_threads=1;

-- executing against localhost:21000

select id from bad_column_metadata;

-- executing against localhost:21000
SET NUM_NODES="0";

-- executing against localhost:21000
SET NUM_SCANNER_THREADS="0";

-- executing against localhost:21000
SELECT * from bad_parquet_strings_negative_len;

-- executing against localhost:21000
SELECT * from bad_parquet_strings_out_of_bounds;

-- executing against localhost:21000
use functional_parquet;

SET batch_size=0;
SET num_nodes=0;
SET disable_codegen_rows_threshold=0;
SET disable_codegen=False;
SET abort_on_error=1;
SET exec_single_node_rows_threshold=0;
-- executing against localhost:21000
set num_nodes=1;

-- executing against localhost:21000

set num_scanner_threads=1;

-- executing against localhost:21000

select id, cnt from bad_column_metadata t, (select count(*) cnt from t.int_array) v;

-- executing against localhost:21000
SET NUM_NODES="0";

-- executing against localhost:21000
SET NUM_SCANNER_THREADS="0";

-- executing against localhost:21000
set num_nodes=1;

-- executing against localhost:21000

set num_scanner_threads=1;

-- executing against localhost:21000

select id from bad_column_metadata;

-- executing against localhost:21000
SET NUM_NODES="0";

-- executing against localhost:21000
SET NUM_SCANNER_THREADS="0";

 

 

Issue Links

• is duplicated by: IMPALA-7378 test_strict_mode failed on an ASAN build: expected "Error converting column: 5 to DOUBLE"
• is duplicated by: IMPALA-7192 test_timestamp_out_of_range doesn't fail on invalid timestamp
• is duplicated by: IMPALA-7512 test_resolution_by_name failed: did not encounter expected error
• is related to: IMPALA-7378 test_strict_mode failed on an ASAN build: expected "Error converting column: 5 to DOUBLE"
• is related to: IMPALA-7418 test_udf_errors - returns Cancelled instead of actual error