[IMPALA-10336] test_type_conversions_hive3 fails because incorrect error is returned to client

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: Impala 4.0.0
• Component/s: Distributed Exec
• Labels: broken-build
• Target Version: Impala 4.0.0
• Epic Color: ghx-label-8
• Assignee: Wenzhe Zhou
• Reporter: Tim Armstrong
• Created: 18/Nov/20 02:12
• Updated: 22/Dec/20 19:54
• Resolved: 22/Dec/20 01:34

Description

Regression

query_test.test_scanners.TestOrc.test_type_conversions_hive3[protocol: beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': True, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: orc/def/block] (from pytest)
Failing for the past 1 build (Since Failed#102 )
Took 1 min 43 sec.
add description
Error Message

query_test/test_scanners.py:1538: in test_type_conversions_hive3     self.run_test_case('DataErrorsTest/orc-type-checks', vector, unique_database) common/impala_test_suite.py:668: in run_test_case     self.__verify_exceptions(test_section['CATCH'], str(e), use_db) common/impala_test_suite.py:485: in __verify_exceptions     (expected_str, actual_str) E   AssertionError: Unexpected exception string. Expected: Type mismatch: table column TINYINT is map to column smallint in ORC file E   Not found in actual: ImpalaBeeswaxException: Query aborted:ExecQueryFInstances rpc query_id=8f461cf08845e57c:32ec8ff300000000 failed: Exec() rpc failed: Aborted: ExecQueryFInstances RPC to 127.0.0.1:27002 is cancelled in state SENT

Stacktrace

query_test/test_scanners.py:1538: in test_type_conversions_hive3
    self.run_test_case('DataErrorsTest/orc-type-checks', vector, unique_database)
common/impala_test_suite.py:668: in run_test_case
    self.__verify_exceptions(test_section['CATCH'], str(e), use_db)
common/impala_test_suite.py:485: in __verify_exceptions
    (expected_str, actual_str)
E   AssertionError: Unexpected exception string. Expected: Type mismatch: table column TINYINT is map to column smallint in ORC file
E   Not found in actual: ImpalaBeeswaxException: Query aborted:ExecQueryFInstances rpc query_id=8f461cf08845e57c:32ec8ff300000000 failed: Exec() rpc failed: Aborted: ExecQueryFInstances RPC to 127.0.0.1:27002 is cancelled in state SENT
....

-- 2020-11-13 23:05:01,187 INFO     MainThread: Started query 62432dd724112633:bd27d62200000000
-- executing against localhost:21000

select c4 from illtypes;

-- 2020-11-13 23:05:01,243 INFO     MainThread: Started query 8f461cf08845e57c:32ec8ff300000000

The problem seems to be that the error that occurs during Prepare() phase is not propagated correctly, and a different internal error wins a race to become the status of the query.

Attached executor logs and the coordinator logs for the query id. The full coordinator log was too big to attach so I put it here: https://drive.google.com/file/d/1hZVi1AmRJ4Lz7yIeJqVpiXeA_MZTP1it/view?usp=sharing

Issue Links

• is duplicated by: IMPALA-10009 test_insert suite's test_insert_bad_expr failed (may be flaky)
• is duplicated by: IMPALA-10357 A test case in test_basic_joins() seems flaky