[IMPALA-11575] TestHdfsScannerSkew.test_mt_dop_skew_lpt fails in test_scanners.py

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Duplicate
• Affects Version/s: Impala 4.2.0
• Component/s: Backend
• Labels: broken-build
• Environment: CentOS 7.9
• Epic Color: ghx-label-14
• Assignee: Zoltán Borók-Nagy
• Reporter: Laszlo Gaal
• Created: 12/Sep/22 11:49
• Updated: 12/Sep/22 12:44
• Resolved: 12/Sep/22 12:44

Description

Failed in an exhaustive build on Git hash 5aff120c40475de35bf45703b3cb953b9ab970f1

Stack traces:
with data format text/none:

query_test.test_scanners.TestHdfsScannerSkew.test_mt_dop_skew_lpt[protocol: beeswax | exec_option: {'test_replan': 1, 'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': True, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: text/none]

query_test/test_scanners.py:428: in test_mt_dop_skew_lpt
    assert cnt_fail < 3
E   assert 3 < 3

with data format text/def/block:

query_test.test_scanners.TestHdfsScannerSkew.test_mt_dop_skew_lpt[protocol: beeswax | exec_option: {'test_replan': 1, 'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': True, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: text/def/block]

query_test/test_scanners.py:428: in test_mt_dop_skew_lpt
    assert cnt_fail < 3
E   assert 4 < 3

Issue Links

• duplicates: IMPALA-11572 TestHdfsScannerSkew.test_mt_dop_skew_lpt is flaky
• is broken by: IMPALA-11539 Mitigate intra-node skew of HDFS scans with MT_DOP