[IMPALA-12527] test_metadata_tables could occasionally fail in the s3 build

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.4.0
• Labels: broken-build flaky-test impala-iceberg
• Epic Color: ghx-label-11
• Assignee: Tamas Mate
• Reporter: Fang-Yu Rao
• Created: 27/Oct/23 22:51
• Updated: 13/Nov/23 15:49
• Resolved: 13/Nov/23 12:18

Description

We found that test_metadata_tables() that runs iceberg-metadata-tables.test could occasionally fail with the following error message.

It looks like the actual result does not match the expected result for some columns.

Stacktrace

query_test/test_iceberg.py:1226: in test_metadata_tables
    '$OVERWRITE_SNAPSHOT_TS': str(overwrite_snapshot_ts.data[0])})
common/impala_test_suite.py:751: in run_test_case
    self.__verify_results_and_errors(vector, test_section, result, use_db)
common/impala_test_suite.py:587: in __verify_results_and_errors
    replace_filenames_with_placeholder)
common/test_result_verifier.py:487: in verify_raw_results
    VERIFIER_MAP[verifier](expected, actual)
common/test_result_verifier.py:296: in verify_query_result_is_equal
    assert expected_results == actual_results
E   assert Comparing QueryTestResults (expected vs actual):
E     row_regex:0,'s3a://impala-test-uswest2-2/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/.*.parq','PARQUET',0,1,[1-9]\d*|0,'',0 != 0,'/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/7d479ffb82bfffd3-7ce667e500000000_544607964_data.0.parq','PARQUET',0,1,351,'NULL',0
E     row_regex:0,'s3a://impala-test-uswest2-2/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/.*.parq','PARQUET',0,1,[1-9]\d*|0,'',0 != 0,'/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/ab4ffd0d75a5a68d-13da083100000000_1541521750_data.0.parq','PARQUET',0,1,351,'NULL',0
E     row_regex:0,'s3a://impala-test-uswest2-2/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/.*.parq','PARQUET',0,1,[1-9]\d*|0,'',0 != 0,'/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/b04d1095845359f5-f0799bd000000000_1209897284_data.0.parq','PARQUET',0,1,351,'NULL',0
E     row_regex:1,'s3a://impala-test-uswest2-2/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/.*.parq','PARQUET',0,1,[1-9]\d*|0,'NULL',NULL != 1,'/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/delete-1b45db885b2bdd56-4023218d00000002_1697110314_data.0.parq','PARQUET',0,1,1531,'NULL',NULL

Specifically, it seems the value of the second last column are different from the expected value in some rows.