[IMPALA-12155] Support Impala CatalogD HA

• Type: Improvement
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: Impala 4.3.0
• Component/s: Backend
• Epic Color: ghx-label-5
• Assignee: Wenzhe Zhou
• Reporter: Wenzhe Zhou
• Created: 23/May/23 00:43
• Updated: 08/Jan/24 15:18
• Resolved: 21/Jun/23 14:24

Description

To support catalog HA, we need to have two CatalogD in HA pair, and add the preemptive behavior for Catalogd. When CatalogD HA is enabled, the preemptive behavior allows the CatalogD with the higher priority to become active and the paired CatalogD becomes standby. The active CatalogD acts as the source of metadata and provides catalog service for the Impala cluster. When active CatalogD is not healthy, the standby CatalogD will take over catalog service.
Preemption is disabled on the CatalogD when it is not running as HA pair.

Issue Links

• breaks: IMPALA-12295 Statestore crashed when restarting catalogd