[IMPALA-6227] TestAdmissionControllerStress can be flaky

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Impala 2.11.0
• Fix Version/s: Impala 2.13.0, Impala 3.1.0
• Component/s: Backend
• Labels: flaky
• Target Version: Impala 2.13.0, Impala 3.1.0
• Epic Color: ghx-label-7
• Assignee: Tim Armstrong
• Reporter: Csaba Ringhofer
• Created: 21/Nov/17 02:14
• Updated: 26/Mar/19 18:54
• Resolved: 08/May/18 22:32

Description

jenkins build https://jenkins.impala.io/job/gerrit-verify-dryrun/1503/console failed at the following test:

01:30:11 ] =================================== FAILURES ===================================
01:30:11 ]  TestAdmissionControllerStress.test_mem_limit[num_queries: 30 | submission_delay_ms: 0 | exec_option: {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 5000, 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: text/none | round_robin_submission: True] 
01:30:11 ] custom_cluster/test_admission_controller.py:877: in test_mem_limit
01:30:11 ]     {'request_pool': self.pool_name, 'mem_limit': query_mem_limit})
01:30:11 ] custom_cluster/test_admission_controller.py:760: in run_admission_test
01:30:11 ]     assert metric_deltas['rejected'] ==\
01:30:11 ] E   assert 5 == ((30 - 15) - 15)

This is probably related to the following recent commit:
https://github.com/apache/incubator-impala/commit/7487c5de04c2c5d97b8a8d5c935d10568f1ed686

Issue Links

• is broken by: IMPALA-1575 Cancelled queries do not yield resources until close
• is duplicated by: IMPALA-6914 test_mem_limit in test_admission_controller timed out waiting for query to end
• is related to: IMPALA-6241 Timeout in TestAdmissionControllerStress.test_mem_limit under ASAN
• is related to: IMPALA-8295 test_mem_limit in test_admission_controller timed out waiting for query to end
• relates to: IMPALA-8342 TestAdmissionControllerStress test_mem_limit run_admission_test failure