Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-7347

Assertion Failure - test_show_create_table

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • Impala 3.1.0
    • Impala 3.1.0
    • None
    • ghx-label-8

    Description

      test_show_create_table in metadata/test_show_create_table.py is failing with the following assertion error

      metadata/test_show_create_table.py:58: in test_show_create_table
          unique_database)
      metadata/test_show_create_table.py:106: in __run_show_create_table_test_case
          self.__compare_result(expected_result, create_table_result)
      metadata/test_show_create_table.py:134: in __compare_result
          assert expected_tbl_props == actual_tbl_props
      E   assert {} == {'numFilesErasureCoded': '0'}
      E     Right contains more items:
      E     {'numFilesErasureCoded': '0'}
      E     Use -v to get the full diff
      

       

      It appears that table property "numFilesErasureCoded" is showing up in table properties.

      Either the test needs updating or a bug.

       

      h3. Error Message
      
      metadata/test_show_create_table.py:58: in test_show_create_table unique_database) metadata/test_show_create_table.py:106: in __run_show_create_table_test_case self.__compare_result(expected_result, create_table_result) metadata/test_show_create_table.py:134: in __compare_result assert expected_tbl_props == actual_tbl_props E assert {} == \{'numFilesErasureCoded': '0'} E Right contains more items: E \{'numFilesErasureCoded': '0'} E Use -v to get the full diff
      
      

       

      h3. Standard Error
      
      -- connecting to: localhost:21000 SET sync_ddl=False; -- executing against localhost:21000 DROP DATABASE IF EXISTS `test_show_create_table_f1598d0b` CASCADE; SET sync_ddl=False; -- executing against localhost:21000 CREATE DATABASE `test_show_create_table_f1598d0b`; MainThread: Created database "test_show_create_table_f1598d0b" for test ID "metadata/test_show_create_table.py::TestShowCreateTable::()::test_show_create_table[table_format: text/none]" -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test1 ( id INT ) STORED AS TEXTFILE; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test1; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test1; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test1 (id INT) STORED AS TEXTFILE LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/test1'; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test1; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test1; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test2 ( year INT, month INT, id INT COMMENT 'Add a comment', bool_col BOOLEAN, tinyint_col TINYINT, smallint_col SMALLINT, int_col INT, bigint_col BIGINT, float_col FLOAT, double_col DOUBLE, date_string_col STRING, string_col STRING, timestamp_col TIMESTAMP ) STORED AS TEXTFILE; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test2; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test2; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test2 (year INT, month INT, id INT COMMENT 'Add a comment', bool_col BOOLEAN, tinyint_col TINYINT, smallint_col SMALLINT, int_col INT, bigint_col BIGINT, float_col FLOAT, double_col DOUBLE, date_string_col STRING, string_col STRING, timestamp_col TIMESTAMP) STORED AS TEXTFILE LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/test2'; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test2; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test2; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test3 ( year INT, month INT, id INT COMMENT 'Add a comment', bool_col BOOLEAN, tinyint_col TINYINT, smallint_col SMALLINT, int_col INT, bigint_col BIGINT, float_col FLOAT, double_col DOUBLE, date_string_col STRING, string_col STRING, timestamp_col TIMESTAMP ) PARTITIONED BY ( x INT, y INT, a BOOLEAN ) COMMENT 'This is a test' STORED AS TEXTFILE; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test3; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test3; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test3 (year INT, month INT, id INT COMMENT 'Add a comment', bool_col BOOLEAN, tinyint_col TINYINT, smallint_col SMALLINT, int_col INT, bigint_col BIGINT, float_col FLOAT, double_col DOUBLE, date_string_col STRING, string_col STRING, timestamp_col TIMESTAMP) PARTITIONED BY (x INT, y INT, a BOOLEAN) COMMENT 'This is a test' STORED AS TEXTFILE LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/test3'; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test3; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test3; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test4 ( year INT, month INT, id INT COMMENT 'Add a comment' ) COMMENT 'This is a test' STORED AS TEXTFILE; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test4; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test4; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test4 (year INT, month INT, id INT COMMENT 'Add a comment') COMMENT 'This is a test' STORED AS TEXTFILE LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/test4'; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test4; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test4; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test5 ( year INT, month INT, id INT COMMENT 'Add a comment' ) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' ESCAPED BY '\\' LINES TERMINATED BY '\n' STORED AS TEXTFILE; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test5; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test5; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test5 (year INT, month INT, id INT COMMENT 'Add a comment') ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' ESCAPED BY '\\' LINES TERMINATED BY '\n' WITH SERDEPROPERTIES ('escape.delim'='\\', 'field.delim'=',', 'line.delim'='\n', 'serialization.format'=',') STORED AS TEXTFILE LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/test5'; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test5; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test5; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test6 ( year INT, month INT, id INT COMMENT 'Add a comment' ) STORED AS PARQUET; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test6; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test6; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test6 (year INT, month INT, id INT COMMENT 'Add a comment') STORED AS PARQUET LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/test6'; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test6; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test6; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test7 ( year INT, month INT, id INT COMMENT 'Add a comment' ) STORED AS SEQUENCEFILE TBLPROPERTIES ('key3'='val3', 'key2'='val2', 'key1'='val1'); -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test7; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test7; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test7 (year INT, month INT, id INT COMMENT 'Add a comment') STORED AS SEQUENCEFILE LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/test7' TBLPROPERTIES ('key1'='val1', 'key2'='val2', 'key3'='val3'); -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test7; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test7; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test8 ( year INT, month INT, id INT COMMENT 'Add a comment' ) STORED AS RCFILE; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test8; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test8; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test8 (year INT, month INT, id INT COMMENT 'Add a comment') STORED AS RCFILE LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/test8'; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test8; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test8; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test_as_select ( id INT, bool_col BOOLEAN, tinyint_col TINYINT, smallint_col SMALLINT, int_col INT, bigint_col BIGINT, float_col FLOAT, double_col DOUBLE, date_string_col STRING, string_col STRING, timestamp_col TIMESTAMP, year INT, month INT ) STORED AS TEXTFILE; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test_as_select; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test_as_select; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.test_as_select (id INT, bool_col BOOLEAN, tinyint_col TINYINT, smallint_col SMALLINT, int_col INT, bigint_col BIGINT, float_col FLOAT, double_col DOUBLE, date_string_col STRING, string_col STRING, timestamp_col TIMESTAMP, year INT, month INT) STORED AS TEXTFILE LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/test_as_select'; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.test_as_select; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.test_as_select; -- executing against localhost:21000 create table test_show_create_table_f1598d0b.i_1687_p partitioned by (int_col) as select bigint_col, int_col from functional.alltypessmall; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.i_1687_p; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.i_1687_p; -- executing against localhost:21000 CREATE TABLE test_show_create_table_f1598d0b.i_1687_p (bigint_col BIGINT) PARTITIONED BY (int_col INT) STORED AS TEXTFILE LOCATION 'hdfs://localhost:20500/test-warehouse/test_show_create_table_f1598d0b.db/i_1687_p'; -- executing against localhost:21000 show create table test_show_create_table_f1598d0b.i_1687_p; -- executing against localhost:21000 drop table test_show_create_table_f1598d0b.i_1687_p; -- executing against localhost:21000 SHOW CREATE TABLE functional_text_lzo.tinytable;
      
      

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            tianyiwang Tianyi Wang
            njanarthanan nithya
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment