Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-10947 SQL support for querying Iceberg metadata
  3. IMPALA-12527

test_metadata_tables could occasionally fail in the s3 build

Agile BoardAttach filesAttach ScreenshotVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • ghx-label-11

    Description

      We found that test_metadata_tables() that runs iceberg-metadata-tables.test could occasionally fail with the following error message.

      It looks like the actual result does not match the expected result for some columns.

      Stacktrace

      query_test/test_iceberg.py:1226: in test_metadata_tables
          '$OVERWRITE_SNAPSHOT_TS': str(overwrite_snapshot_ts.data[0])})
      common/impala_test_suite.py:751: in run_test_case
          self.__verify_results_and_errors(vector, test_section, result, use_db)
      common/impala_test_suite.py:587: in __verify_results_and_errors
          replace_filenames_with_placeholder)
      common/test_result_verifier.py:487: in verify_raw_results
          VERIFIER_MAP[verifier](expected, actual)
      common/test_result_verifier.py:296: in verify_query_result_is_equal
          assert expected_results == actual_results
      E   assert Comparing QueryTestResults (expected vs actual):
      E     row_regex:0,'s3a://impala-test-uswest2-2/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/.*.parq','PARQUET',0,1,[1-9]\d*|0,'',0 != 0,'/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/7d479ffb82bfffd3-7ce667e500000000_544607964_data.0.parq','PARQUET',0,1,351,'NULL',0
      E     row_regex:0,'s3a://impala-test-uswest2-2/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/.*.parq','PARQUET',0,1,[1-9]\d*|0,'',0 != 0,'/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/ab4ffd0d75a5a68d-13da083100000000_1541521750_data.0.parq','PARQUET',0,1,351,'NULL',0
      E     row_regex:0,'s3a://impala-test-uswest2-2/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/.*.parq','PARQUET',0,1,[1-9]\d*|0,'',0 != 0,'/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/b04d1095845359f5-f0799bd000000000_1209897284_data.0.parq','PARQUET',0,1,351,'NULL',0
      E     row_regex:1,'s3a://impala-test-uswest2-2/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/.*.parq','PARQUET',0,1,[1-9]\d*|0,'NULL',NULL != 1,'/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/delete-1b45db885b2bdd56-4023218d00000002_1697110314_data.0.parq','PARQUET',0,1,1531,'NULL',NULL
      

      Specifically, it seems the value of the second last column are different from the expected value in some rows.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            tmate Tamas Mate
            fangyurao Fang-Yu Rao
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment