[IMPALA-11239] test_parquet_count_star_optimization fail in downstream erasure code build

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 4.0.0
• Fix Version/s: Impala 4.1.0
• Component/s: Infrastructure
• Target Version: Impala 4.1.0
• Epic Color: ghx-label-11
• Assignee: Riza Suminto
• Reporter: Riza Suminto
• Created: 12/Apr/22 22:28
• Updated: 26/Apr/22 16:18
• Resolved: 26/Apr/22 16:18

Description

IMPALA-11123 add assertion to verify NumFileMetadataRead in parquet-stats-agg.test. We found that in the multiblock test, the number of NumFileMetadataRead can differ in erasure coding configuration. This is most likely because erasure coded setup create less files. Below is the stack trace:

query_test/test_aggregation.py:331: in test_parquet_count_star_optimization
    self.run_test_case('QueryTest/parquet-stats-agg', vector, unique_database)
common/impala_test_suite.py:743: in run_test_case
    update_section=pytest.config.option.update_results)
common/test_result_verifier.py:653: in verify_runtime_profile
    % (function, field, expected_value, actual_value, op, actual))
E   AssertionError: Aggregation of SUM over NumFileMetadataRead did not match expected results.
E   EXPECTED VALUE:
E   6
E   
E   
E   ACTUAL VALUE:
E   5
E   
E   OP:
E   :
E