[IMPALA-11508] Iceberg test test_expire_snapshots is flaky

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.2.0
• Component/s: Catalog
• Labels: broken-build impala-iceberg
• Epic Color: ghx-label-10
• Assignee: Zoltán Borók-Nagy
• Reporter: Zoltán Borók-Nagy
• Created: 18/Aug/22 10:18
• Updated: 27/Sep/22 07:16
• Resolved: 27/Sep/22 07:16

Description

Stacktrace

query_test/test_iceberg.py:104: in test_expire_snapshots
    impalad_client.execute(insert_q)
common/impala_connection.py:212: in execute
    return self.__beeswax_client.execute(sql_stmt, user=user)
beeswax/impala_beeswax.py:189: in execute
    handle = self.__execute_query(query_string.strip(), user=user)
beeswax/impala_beeswax.py:365: in __execute_query
    handle = self.execute_query_async(query_string, user=user)
beeswax/impala_beeswax.py:359: in execute_query_async
    handle = self.__do_rpc(lambda: self.imp_service.query(query,))
beeswax/impala_beeswax.py:522: in __do_rpc
    raise ImpalaBeeswaxException(self.__build_error_message(b), b)
E   ImpalaBeeswaxException: ImpalaBeeswaxException:
E    INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
E    MESSAGE: AnalysisException: org.apache.impala.catalog.TableLoadingException: Error opening Iceberg table 'test_expire_snapshots_e488dbc3.expire_snapshots'
E   CAUSED BY: TableLoadingException: Error opening Iceberg table 'test_expire_snapshots_e488dbc3.expire_snapshots'
E   CAUSED BY: InconsistentMetadataFetchException: Catalog object TCatalogObject(type:TABLE, catalog_version:7309, table:TTable(db_name:test_expire_snapshots_e488dbc3, tbl_name:expire_snapshots)) changed version between accesses.

The error might be due to not detecting all self-events correctly, so the IcebergTable gets updated on the CatalogD side.