[IMPALA-12323] DDL hang with SYNC_DDL=1 when CatalogD HA enabled

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Impala 4.3.0
• Fix Version/s: Impala 4.3.0
• Component/s: Backend
• Target Version: Impala 4.3.0
• Epic Color: ghx-label-11
• Assignee: Wenzhe Zhou
• Reporter: Wenzhe Zhou
• Created: 28/Jul/23 17:00
• Updated: 31/Jul/23 05:05
• Resolved: 31/Jul/23 05:05

Description

When CatalogD HA is enabled, standby catalogd does not receive catalog topic update from statestore and does not apply catalog updates from the active catalogd. Its min topic version is not changed.
Function Statestore::GetMinSubscriberTopicVersion() loops through all subscribers including standby catalogd to find min topic version. Standby catalogd causes min_subscriber_topic_version not increased, and hence Impala server waits indefinitely in ImpalaServer::WaitForCatalogUpdateTopicPropagation().

To fix the issue, skip standby catalogd when finding min topic version in Statestore::GetMinSubscriberTopicVersion().