[IMPALA-9834] test_query_retries.TestQueryRetries is flaky on erasure coding configurations

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 4.0.0
• Fix Version/s: Impala 4.0.0
• Component/s: Backend
• Labels: broken-build flaky
• Target Version: Impala 4.0.0
• Epic Color: ghx-label-4
• Assignee: Sahil Takiar
• Reporter: Joe McDonnell
• Created: 05/Jun/20 19:17
• Updated: 10/Jul/20 17:23
• Resolved: 10/Jul/20 17:22

Description

Multiple tests from test_query_retries.TestQueryRetries hit errors like this (test_retry_query_cancel):

custom_cluster/test_query_retries.py:321: in test_retry_query_cancel
    self.__validate_runtime_profiles_from_service(impalad_service, handle)
custom_cluster/test_query_retries.py:435: in __validate_runtime_profiles_from_service
    self.__validate_runtime_profiles(retried_profile, handle.get_handle().id)
custom_cluster/test_query_retries.py:503: in __validate_runtime_profiles
    retried_query_id = self.__get_query_id_from_profile(retried_runtime_profile)
custom_cluster/test_query_retries.py:474: in __get_query_id_from_profile
    assert query_id_search, "Invalid query profile, has no query id"
E   AssertionError: Invalid query profile, has no query id
E   assert None

Or this (test_kill_impalad_expect_retries, test_kill_impalad_expect_retry, test_retry_query_hs2):

custom_cluster/test_query_retries.py:424: in test_retry_query_hs2
    self.hs2_client.get_query_id(handle))
custom_cluster/test_query_retries.py:508: in __validate_runtime_profiles
    original_query_id)
custom_cluster/test_query_retries.py:489: in __validate_original_id_in_profile
    assert original_id_search, \
E   AssertionError: Could not find original id pattern 'Original Query Id: (.*)' in profile:
...

I have only seen these errors on erasure coding so far, and it isn't deterministic.

Issue Links

• is duplicated by: IMPALA-9880 test_query_retries.TestQueryRetries.test_kill_impalad_expect_retries fails on EC enabled builds
• relates to: IMPALA-9124 Transparently retry queries that fail due to cluster membership changes