[IMPALA-9702] TestDdlStatements::test_alter_table() and TestMixedPartitions::test_incompatible_avro_partition_in_non_avro_table() consistently fail on S3

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Impala 4.0.0
• Fix Version/s: Impala 4.0.0
• Target Version: Impala 4.0.0
• Epic Color: ghx-label-14
• Assignee: Joe McDonnell
• Reporter: Bikramjeet Vig
• Created: 28/Apr/20 01:42
• Updated: 23/Dec/20 19:59
• Resolved: 04/Jun/20 15:20

Description

Two tests consistently fail on S3 after the switch to USE_CDP_HIVE=true by default.

metadata/test_ddl.py::TestDdlStatements::test_alter_table():

metadata/test_ddl.py:445: in test_alter_table
    multiple_impalad=self._use_multiple_impalad(vector))
common/impala_test_suite.py:687: in run_test_case
    self.__verify_results_and_errors(vector, test_section, result, use_db)
common/impala_test_suite.py:523: in __verify_results_and_errors
    replace_filenames_with_placeholder)
common/test_result_verifier.py:456: in verify_raw_results
    VERIFIER_MAP[verifier](expected, actual)
common/test_result_verifier.py:278: in verify_query_result_is_equal
    assert expected_results == actual_results
E   assert Comparing QueryTestResults (expected vs actual):
E     1,1,'2012/withslash' == 1,1,'2012/withslash'
E     2,1,'2012' == 2,1,'2012'
E     2,1,'2012' == 2,1,'2012'
E     3,1,'2013' == 3,1,'2013'
E     3,1,'2013' == 3,1,'2013'
E     3,1,'2013' == 3,1,'2013'
E     4,NULL,'NULL' == 4,NULL,'NULL'
E     4,NULL,'NULL' == 4,NULL,'NULL'
E     4,NULL,'NULL' == 4,NULL,'NULL'
E     4,NULL,'NULL' == 4,NULL,'NULL'
E     4,NULL,'NULL' == 4,NULL,'NULL'
E     None != 5,NULL,'2013'
E     None != 5,NULL,'2013'
E     None != 5,NULL,'2013'
E     None != 5,NULL,'2013'
E     None != 5,NULL,'2013'
E     Number of rows returned (expected vs actual): 11 != 16

metadata/test_partition_metadata.py::TestMixedPartitions.test_incompatible_avro_partition_in_non_avro_table():

metadata/test_partition_metadata.py:151: in test_incompatible_avro_partition_in_non_avro_table
    test_file_vars={'$MAIN_TABLE_FORMAT': main_table_format})
common/impala_test_suite.py:687: in run_test_case
    self.__verify_results_and_errors(vector, test_section, result, use_db)
common/impala_test_suite.py:523: in __verify_results_and_errors
    replace_filenames_with_placeholder)
common/test_result_verifier.py:456: in verify_raw_results
    VERIFIER_MAP[verifier](expected, actual)
common/test_result_verifier.py:278: in verify_query_result_is_equal
    assert expected_results == actual_results
E   assert Comparing QueryTestResults (expected vs actual):
E     1,false,2,3,4,5,6,7,'1985-07-15','c2','my va',1 == 1,false,2,3,4,5,6,7,'1985-07-15','c2','my va',1
E     None != 1,false,2,3,4,5,6,7,'1985-07-15','c2','my va',1
E     Number of rows returned (expected vs actual): 1 != 2

Issue Links

• fixes: IMPALA-9420 test_scanners.TestOrc.test_type conversions fails after first run
• is related to: IMPALA-9759 Revisit integration of snapshot dataload with s3guard