Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-10624

TestIcebergTable::test_alter_iceberg_tables failed by stale file format

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: Impala 4.0.0
    • Component/s: Catalog
    • Labels:
      None
    • Epic Color:
      ghx-label-6

      Description

      TestIcebergTable::test_alter_iceberg_tables fails in a downstream core build:

      query_test/test_iceberg.py:50: in test_alter_iceberg_tables
          self.run_test_case('QueryTest/iceberg-alter', vector, use_db=unique_database)
      common/impala_test_suite.py:665: in run_test_case
          result = exec_fn(query, user=test_section.get('USER', '').strip() or None)
      common/impala_test_suite.py:603: in __exec_in_impala
          result = self.__execute_query(target_impalad_client, query, user=user)
      common/impala_test_suite.py:923: in __execute_query
          return impalad_client.execute(query, user=user)
      common/impala_connection.py:205: in execute
          return self.__beeswax_client.execute(sql_stmt, user=user)
      beeswax/impala_beeswax.py:187: in execute
          handle = self.__execute_query(query_string.strip(), user=user)
      beeswax/impala_beeswax.py:365: in __execute_query
          self.wait_for_finished(handle)
      beeswax/impala_beeswax.py:386: in wait_for_finished
          raise ImpalaBeeswaxException("Query aborted:" + error_log, None)
      E   ImpalaBeeswaxException: ImpalaBeeswaxException:
      E    Query aborted:Encountered parse error in tail of ORC file hdfs://localhost:20500/test-warehouse/test_alter_iceberg_tables_f665cbcc.db/iceberg_changing_fileformats/data/d94f2a969c360675-cd07d0bb00000000_1360147332_data.0.parq: Not an ORC file
      

      The last several queries are

      ALTER TABLE iceberg_changing_fileformats set TBLPROPERTIES('iceberg.file_format'='parquet');
      
      -- 2021-03-29 19:23:30,588 INFO     MainThread: Started query 344ec76ac00e022e:1685ff5200000000
      -- executing against localhost:21000
      
      
      DESCRIBE FORMATTED iceberg_changing_fileformats;
      
      -- 2021-03-29 19:23:30,595 INFO     MainThread: Started query d2455af1b84c7f10:1edbc8f600000000
      -- executing against localhost:21000
      
      INSERT INTO iceberg_changing_fileformats values (123);
      
      -- 2021-03-29 19:23:30,605 INFO     MainThread: Started query d94f2a969c360675:cd07d0bb00000000
      -- executing against localhost:21000
      
      
      SELECT * FROM iceberg_changing_fileformats;
      
      -- 2021-03-29 19:23:30,824 INFO     MainThread: Started query c74f132c2eda13fc:0b27b87000000000
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                boroknagyz Zoltán Borók-Nagy
                Reporter:
                stigahuang Quanlong Huang
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: