[IMPALA-7405] Save jenkins artifacts when aborted by a timeout

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 3.1.0
• Fix Version/s: Impala 3.2.0
• Component/s: Infrastructure
• Labels: flaky-build
• Epic Color: ghx-label-6
• Assignee: Unassigned
• Reporter: Vuk Ercegovac
• Created: 07/Aug/18 02:30
• Updated: 23/Dec/20 22:42
• Resolved: 23/Dec/20 22:42

Description

Occasionally, builds abort due to timeouts. See: https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/2882 for an example. At the end of the run, there's a large time gap:

...
20:08:21 [gw12] PASSED query_test/test_spilling.py::TestSpillingDebugActionDimensions::test_spilling_naaj[exec_option: {'debug_action': None, 'default_spillable_buffer_size': '256k'} | table_format: parquet/none] 
20:08:21 query_test/test_spilling.py::TestSpillingDebugActionDimensions::test_spilling_naaj[exec_option: {'debug_action': '-1:OPEN:SET_DENY_RESERVATION_PROBABILITY@1.0', 'default_spillable_buffer_size': '256k'} | table_format: parquet/none] 
20:09:51 [gw12] PASSED query_test/test_spilling.py::TestSpillingDebugActionDimensions::test_spilling_naaj[exec_option: {'debug_action': '-1:OPEN:SET_DENY_RESERVATION_PROBABILITY@1.0', 'default_spillable_buffer_size': '256k'} | table_format: parquet/none] 
20:09:51 query_test/test_spilling.py::TestSpillingDebugActionDimensions::test_spilling_regression_exhaustive[exec_option: {'debug_action': None, 'default_spillable_buffer_size': '256k'} | table_format: parquet/none] 
20:09:51 [gw12] SKIPPED query_test/test_spilling.py::TestSpillingDebugActionDimensions::test_spilling_regression_exhaustive[exec_option: {'debug_action': None, 'default_spillable_buffer_size': '256k'} | table_format: parquet/none] 
20:09:51 query_test/test_spilling.py::TestSpillingDebugActionDimensions::test_spilling_regression_exhaustive[exec_option: {'debug_action': '-1:OPEN:SET_DENY_RESERVATION_PROBABILITY@1.0', 'default_spillable_buffer_size': '256k'} | table_format: parquet/none] 
20:09:51 [gw12] SKIPPED query_test/test_spilling.py::TestSpillingDebugActionDimensions::test_spilling_regression_exhaustive[exec_option: {'debug_action': '-1:OPEN:SET_DENY_RESERVATION_PROBABILITY@1.0', 'default_spillable_buffer_size': '256k'} | table_format: parquet/none] Set build name. 
03:38:00 New build name is '#2882 master' 
03:38:00 Build was aborted 
03:38:00 Calling Pipeline was cancelled 
03:38:00 Archiving artifacts 
03:38:00 Recording test results 
03:38:01 None of the test reports contained any result 
03:38:01 Finished: ABORTED

However, no artifacts were saved so we can't see what was going on during that 7 hour gap. Similar issues have hindered debugging other cases that timeout once in a while: https://issues.apache.org/jira/browse/IMPALA-6352