[IMPALA-10301] Insert query hangs in test_local_catalog_ddls_with_invalidate_metadata_sync_ddl

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Cannot Reproduce
• Component/s: Catalog
• Labels: broken-build flaky hang
• Epic Color: ghx-label-2
• Assignee: Wenzhe Zhou
• Reporter: Qifan Chen
• Created: 28/Oct/20 13:55
• Updated: 21/Sep/21 23:34
• Resolved: 21/Sep/21 23:34

Description

In impala-cdpd-master-staging-core-s3 test, the following error was seen (insert into a partitioned table timeout).

Error Message

AssertionError: Query timeout(60s): insert overwrite table test_local_catalog_ddls_with_invalidate_metadata_sync_ddl_b87f02d6.test_2_part partition(j=2) values (1), (2), (3), (4), (5) assert False
Stacktrace

custom_cluster/test_concurrent_ddls.py:83: in test_local_catalog_ddls_with_invalidate_metadata_sync_ddl
    self._run_ddls_with_invalidation(unique_database, sync_ddl=True)
custom_cluster/test_concurrent_ddls.py:146: in _run_ddls_with_invalidation
    for i in pool.imap_unordered(run_ddls, xrange(1, NUM_ITERS + 1)):
/usr/lib64/python2.7/multiprocessing/pool.py:655: in next
    raise value
E   AssertionError: Query timeout(60s): insert overwrite table test_local_catalog_ddls_with_invalidate_metadata_sync_ddl_b87f02d6.test_2_part partition(j=2) values (1), (2), (3), (4), (5)
E   assert False

The URL is https://master-02.jenkins.cloudera.com/view/Impala/view/Evergreen-cdpd-master-staging/job/impala-cdpd-master-staging-core-s3/lastCompletedBuild/testReport/custom_cluster.test_concurrent_ddls/TestConcurrentDdls/test_local_catalog_ddls_with_invalidate_metadata_sync_ddl/.

Issue Links

• is duplicated by: IMPALA-10311 custom_cluster.test_concurrent_ddls.TestConcurrentDdls query timeout
• is related to: IMPALA-10338 TestAdmissionController.test_queue_reasons_slots flaky because of slow/hanging fragment
• is related to: IMPALA-10369 Dump server stacktraces when test_concurrent_ddls.py timeout
• relates to: IMPALA-10363 test_mixed_catalog_ddls_with_invalidate_metadata failed after reaching timeout (120 seconds)