[IMPALA-7347] Assertion Failure - test_show_create_table

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 3.1.0
• Fix Version/s: Impala 3.1.0
• Labels: build-failure
• Epic Color: ghx-label-8
• Assignee: Tianyi Wang
• Reporter: nithya
• Created: 25/Jul/18 17:06
• Updated: 14/Aug/18 01:35
• Resolved: 14/Aug/18 01:35

Description

test_show_create_table in metadata/test_show_create_table.py is failing with the following assertion error

metadata/test_show_create_table.py:58: in test_show_create_table
    unique_database)
metadata/test_show_create_table.py:106: in __run_show_create_table_test_case
    self.__compare_result(expected_result, create_table_result)
metadata/test_show_create_table.py:134: in __compare_result
    assert expected_tbl_props == actual_tbl_props
E   assert {} == {'numFilesErasureCoded': '0'}
E     Right contains more items:
E     {'numFilesErasureCoded': '0'}
E     Use -v to get the full diff

 

It appears that table property "numFilesErasureCoded" is showing up in table properties.

Either the test needs updating or a bug.

 

h3. Error Message

metadata/test_show_create_table.py:58: in test_show_create_table unique_database) metadata/test_show_create_table.py:106: in __run_show_create_table_test_case self.__compare_result(expected_result, create_table_result) metadata/test_show_create_table.py:134: in __compare_result assert expected_tbl_props == actual_tbl_props E assert {} == \{'numFilesErasureCoded': '0'} E Right contains more items: E \{'numFilesErasureCoded': '0'} E Use -v to get the full diff

 

—

h3. Standard Error

-- connecting to: localhost:21000 SET sync_ddl=False; -- executing against localhost:21000 DROP DATABASE IF EXISTS `test_show_create_table_f1598d0b` CASCADE; SET sync_ddl=False; -- executing against localhost:21000 CREATE DATABASE `test_show_create_table_f1598d0b`; MainThread: Created database "test_show_create_table_f1598d0b" for test ID "metadata/test_show_create_table.py::TestShowCreateTable::()::test_show_create_table[table_format: text/none]" -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test1 ( id INT ) STORED AS TEXTFILE; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test1; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test1; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test1 (id INT) STORED AS TEXTFILE LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/test1'; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test1; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test1; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test2 ( year INT, month INT, id INT COMMENT 'Add a comment', bool_col BOOLEAN, tinyint_col TINYINT, smallint_col SMALLINT, int_col INT, bigint_col BIGINT, float_col FLOAT, double_col DOUBLE, date_string_col STRING, string_col STRING, timestamp_col TIMESTAMP ) STORED AS TEXTFILE; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test2; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test2; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test2 (year INT, month INT, id INT COMMENT 'Add a comment', bool_col BOOLEAN, tinyint_col TINYINT, smallint_col SMALLINT, int_col INT, bigint_col BIGINT, float_col FLOAT, double_col DOUBLE, date_string_col STRING, string_col STRING, timestamp_col TIMESTAMP) STORED AS TEXTFILE LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/test2'; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test2; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test2; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test3 ( year INT, month INT, id INT COMMENT 'Add a comment', bool_col BOOLEAN, tinyint_col TINYINT, smallint_col SMALLINT, int_col INT, bigint_col BIGINT, float_col FLOAT, double_col DOUBLE, date_string_col STRING, string_col STRING, timestamp_col TIMESTAMP ) PARTITIONED BY ( x INT, y INT, a BOOLEAN ) COMMENT 'This is a test' STORED AS TEXTFILE; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test3; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test3; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test3 (year INT, month INT, id INT COMMENT 'Add a comment', bool_col BOOLEAN, tinyint_col TINYINT, smallint_col SMALLINT, int_col INT, bigint_col BIGINT, float_col FLOAT, double_col DOUBLE, date_string_col STRING, string_col STRING, timestamp_col TIMESTAMP) PARTITIONED BY (x INT, y INT, a BOOLEAN) COMMENT 'This is a test' STORED AS TEXTFILE LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/test3'; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test3; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test3; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test4 ( year INT, month INT, id INT COMMENT 'Add a comment' ) COMMENT 'This is a test' STORED AS TEXTFILE; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test4; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test4; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test4 (year INT, month INT, id INT COMMENT 'Add a comment') COMMENT 'This is a test' STORED AS TEXTFILE LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/test4'; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test4; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test4; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test5 ( year INT, month INT, id INT COMMENT 'Add a comment' ) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' ESCAPED BY '\\' LINES TERMINATED BY '\n' STORED AS TEXTFILE; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test5; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test5; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test5 (year INT, month INT, id INT COMMENT 'Add a comment') ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' ESCAPED BY '\\' LINES TERMINATED BY '\n' WITH SERDEPROPERTIES ('escape.delim'='\\', 'field.delim'=',', 'line.delim'='\n', 'serialization.format'=',') STORED AS TEXTFILE LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/test5'; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test5; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test5; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test6 ( year INT, month INT, id INT COMMENT 'Add a comment' ) STORED AS PARQUET; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test6; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test6; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test6 (year INT, month INT, id INT COMMENT 'Add a comment') STORED AS PARQUET LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/test6'; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test6; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test6; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test7 ( year INT, month INT, id INT COMMENT 'Add a comment' ) STORED AS SEQUENCEFILE TBLPROPERTIES ('key3'='val3', 'key2'='val2', 'key1'='val1'); -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test7; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test7; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test7 (year INT, month INT, id INT COMMENT 'Add a comment') STORED AS SEQUENCEFILE LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/test7' TBLPROPERTIES ('key1'='val1', 'key2'='val2', 'key3'='val3'); -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test7; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test7; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test8 ( year INT, month INT, id INT COMMENT 'Add a comment' ) STORED AS RCFILE; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test8; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test8; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test8 (year INT, month INT, id INT COMMENT 'Add a comment') STORED AS RCFILE LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/test8'; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test8; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test8; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test_as_select ( id INT, bool_col BOOLEAN, tinyint_col TINYINT, smallint_col SMALLINT, int_col INT, bigint_col BIGINT, float_col FLOAT, double_col DOUBLE, date_string_col STRING, string_col STRING, timestamp_col TIMESTAMP, year INT, month INT ) STORED AS TEXTFILE; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test_as_select; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test_as_select; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test_as_select (id INT, bool_col BOOLEAN, tinyint_col TINYINT, smallint_col SMALLINT, int_col INT, bigint_col BIGINT, float_col FLOAT, double_col DOUBLE, date_string_col STRING, string_col STRING, timestamp_col TIMESTAMP, year INT, month INT) STORED AS TEXTFILE LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/test_as_select'; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test_as_select; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test_as_select; -- executing against localhost:21000 create table test_show_create_table_f1598d0b.i_1687_p partitioned by (int_col) as select bigint_col, int_col from functional.alltypessmall; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.i_1687_p; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.i_1687_p; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.i_1687_p (bigint_col BIGINT) PARTITIONED BY (int_col INT) STORED AS TEXTFILE LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/i_1687_p'; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.i_1687_p; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.i_1687_p; -- executing against localhost:21000 SHOW CREATE TABLE functional_text_lzo.tinytable;