[IMPALA-10534] TestScratchDir.test_scratch_dirs_remote_spill_with_options seems flaky

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 4.0.0
• Fix Version/s: Impala 4.0.0
• Component/s: Backend
• Labels: broken-build
• Epic Color: ghx-label-12
• Assignee: Yida Wu
• Reporter: Wenzhe Zhou
• Created: 21/Feb/21 05:59
• Updated: 01/Mar/21 16:49
• Resolved: 01/Mar/21 16:49

Description

TestScratchDir.test_scratch_dirs_remote_spill_with_options failed in exhaustive release build.

Error Message
ImpalaBeeswaxException: ImpalaBeeswaxException: INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'> MESSAGE: Cancelled in TmpFileBufferPool because: Timeout waiting for a local buffer in 60 seconds Cancelled in TmpFileBufferPool because: Timeout waiting for a local buffer in 60 seconds

Stacktrace
custom_cluster/test_scratch_disk.py:384: in test_scratch_dirs_remote_spill_with_options
results = client.fetch(self.spill_query, handle)
common/impala_connection.py:254: in fetch
sql_stmt, operation_handle.get_handle(), max_rows)
beeswax/impala_beeswax.py:452: in fetch_results
exec_result = self.__fetch_results(query_handle, max_rows)
beeswax/impala_beeswax.py:463: in __fetch_results
results = self.__do_rpc(lambda: self.imp_service.fetch(handle, False, fetch_rows))
beeswax/impala_beeswax.py:520: in __do_rpc
raise ImpalaBeeswaxException(self.__build_error_message(b), b)
E ImpalaBeeswaxException: ImpalaBeeswaxException:
E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
E MESSAGE: Cancelled in TmpFileBufferPool because: Timeout waiting for a local buffer in 60 seconds
E
E Cancelled in TmpFileBufferPool because: Timeout waiting for a local buffer in 60 seconds

Issue Links

• is caused by: IMPALA-9867 Add Support for Spilling to HDFS