[IMPALA-10624] TestIcebergTable::test_alter_iceberg_tables failed by stale file format

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: Impala 4.0.0
• Component/s: Catalog
• Epic Color: ghx-label-6
• Assignee: Zoltán Borók-Nagy
• Reporter: Quanlong Huang
• Created: 30/Mar/21 12:14
• Updated: 05/Apr/21 08:38
• Resolved: 02/Apr/21 08:02

Description

TestIcebergTable::test_alter_iceberg_tables fails in a downstream core build:

query_test/test_iceberg.py:50: in test_alter_iceberg_tables
    self.run_test_case('QueryTest/iceberg-alter', vector, use_db=unique_database)
common/impala_test_suite.py:665: in run_test_case
    result = exec_fn(query, user=test_section.get('USER', '').strip() or None)
common/impala_test_suite.py:603: in __exec_in_impala
    result = self.__execute_query(target_impalad_client, query, user=user)
common/impala_test_suite.py:923: in __execute_query
    return impalad_client.execute(query, user=user)
common/impala_connection.py:205: in execute
    return self.__beeswax_client.execute(sql_stmt, user=user)
beeswax/impala_beeswax.py:187: in execute
    handle = self.__execute_query(query_string.strip(), user=user)
beeswax/impala_beeswax.py:365: in __execute_query
    self.wait_for_finished(handle)
beeswax/impala_beeswax.py:386: in wait_for_finished
    raise ImpalaBeeswaxException("Query aborted:" + error_log, None)
E   ImpalaBeeswaxException: ImpalaBeeswaxException:
E    Query aborted:Encountered parse error in tail of ORC file hdfs://localhost:20500/test-warehouse/test_alter_iceberg_tables_f665cbcc.db/iceberg_changing_fileformats/data/d94f2a969c360675-cd07d0bb00000000_1360147332_data.0.parq: Not an ORC file

The last several queries are

ALTER TABLE iceberg_changing_fileformats set TBLPROPERTIES('iceberg.file_format'='parquet');

-- 2021-03-29 19:23:30,588 INFO     MainThread: Started query 344ec76ac00e022e:1685ff5200000000
-- executing against localhost:21000


DESCRIBE FORMATTED iceberg_changing_fileformats;

-- 2021-03-29 19:23:30,595 INFO     MainThread: Started query d2455af1b84c7f10:1edbc8f600000000
-- executing against localhost:21000

INSERT INTO iceberg_changing_fileformats values (123);

-- 2021-03-29 19:23:30,605 INFO     MainThread: Started query d94f2a969c360675:cd07d0bb00000000
-- executing against localhost:21000


SELECT * FROM iceberg_changing_fileformats;

-- 2021-03-29 19:23:30,824 INFO     MainThread: Started query c74f132c2eda13fc:0b27b87000000000

Issue Links

• is caused by: IMPALA-10597 Enable setting 'iceberg.file_format'