[IMPALA-13388] TestStatestoredHA.test_statestored_auto_failover failed in UBSAN ARM

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.5.0
• Component/s: Test
• Labels: flaky
• Target Version: Impala 4.5.0
• Epic Color: ghx-label-12
• Assignee: Wenzhe Zhou
• Reporter: Riza Suminto
• Created: 17/Sep/24 16:00
• Updated: 24/Sep/24 06:02
• Resolved: 24/Sep/24 05:41

Description

TestStatestoredHA.test_statestored_auto_failover failed in UBSAN ARM environment. Here is the stack trace:

Stacktrace

custom_cluster/test_statestored_ha.py:340: in test_statestored_auto_failover
    self.__test_statestored_auto_failover()
custom_cluster/test_statestored_ha.py:259: in __test_statestored_auto_failover
    "statestore.active-status", expected_value=True, timeout=120)
common/impala_service.py:144: in wait_for_metric_value
    self.__metric_timeout_assert(metric_name, expected_value, timeout)
common/impala_service.py:213: in __metric_timeout_assert
    assert 0, assert_string
E   AssertionError: Metric statestore.active-status did not reach value True in 120s.
E   Dumping debug webpages in JSON format...
E   Dumped memz JSON to $IMPALA_HOME/logs/metric_timeout_diags_20240917_00:07:51/json/memz.json
E   Dumped metrics JSON to $IMPALA_HOME/logs/metric_timeout_diags_20240917_00:07:51/json/metrics.json
E   Dumped queries JSON to $IMPALA_HOME/logs/metric_timeout_diags_20240917_00:07:51/json/queries.json
E   Dumped sessions JSON to $IMPALA_HOME/logs/metric_timeout_diags_20240917_00:07:51/json/sessions.json
E   Dumped threadz JSON to $IMPALA_HOME/logs/metric_timeout_diags_20240917_00:07:51/json/threadz.json
E   Dumped rpcz JSON to $IMPALA_HOME/logs/metric_timeout_diags_20240917_00:07:51/json/rpcz.json
E   Dumping minidumps for impalads/catalogds...
E   Dumped minidump for Impalad PID 3729004
E   Dumped minidump for Impalad PID 3729007
E   Dumped minidump for Impalad PID 3729011
E   Dumped minidump for Catalogd PID 3728915

Maybe 120 seconds timeout is not enough in UBSAN ARM environment?