[IMPALA-7068] Failed test: metadata.test_partition_metadata.TestPartitionMetadataUncompressedTextOnly.test_unsupported_text_compression on S3

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 3.0
• Fix Version/s: Impala 3.1.0
• Component/s: Catalog, Infrastructure
• Labels: S3 broken-build test-failure
• Epic Color: ghx-label-2
• Assignee: Daniel Hecht
• Reporter: Dimitris Tsirogiannis
• Created: 24/May/18 16:30
• Updated: 08/Jun/18 15:50
• Resolved: 25/May/18 17:06

Description

This is from executing the failed test. It seems that the S3 prefix (s3a://impala-cdh5-s3-tests) is added twice to the table location, resulting in an invalid S3 path. 

Error Message
metadata/test_partition_metadata.py:177: in test_unsupported_text_compression     FQ_TBL_NAME, TBL_LOCATION)) common/impala_connection.py:160: in execute     return self.__beeswax_client.execute(sql_stmt, user=user) beeswax/impala_beeswax.py:173: in execute     handle = self.__execute_query(query_string.strip(), user=user) beeswax/impala_beeswax.py:339: in __execute_query     handle = self.execute_query_async(query_string, user=user) beeswax/impala_beeswax.py:335: in execute_query_async     return self.__do_rpc(lambda: self.imp_service.query(query,)) beeswax/impala_beeswax.py:460: in __do_rpc     raise ImpalaBeeswaxException(self.__build_error_message(b), b) E   ImpalaBeeswaxException: ImpalaBeeswaxException: E    INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'> E    MESSAGE: AnalysisException: Bucket impala-cdh5-s3-tests3a does not exist E   CAUSED BY: FileNotFoundException: Bucket impala-cdh5-s3-tests3a does not exist
Stacktrace
metadata/test_partition_metadata.py:177: in test_unsupported_text_compression
    FQ_TBL_NAME, TBL_LOCATION))
common/impala_connection.py:160: in execute
    return self.__beeswax_client.execute(sql_stmt, user=user)
beeswax/impala_beeswax.py:173: in execute
    handle = self.__execute_query(query_string.strip(), user=user)
beeswax/impala_beeswax.py:339: in __execute_query
    handle = self.execute_query_async(query_string, user=user)
beeswax/impala_beeswax.py:335: in execute_query_async
    return self.__do_rpc(lambda: self.imp_service.query(query,))
beeswax/impala_beeswax.py:460: in __do_rpc
    raise ImpalaBeeswaxException(self.__build_error_message(b), b)
E   ImpalaBeeswaxException: ImpalaBeeswaxException:
E    INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
E    MESSAGE: AnalysisException: Bucket impala-cdh5-s3-tests3a does not exist
E   CAUSED BY: FileNotFoundException: Bucket impala-cdh5-s3-tests3a does not exist
Standard Error
-- connecting to: localhost:21000
SET sync_ddl=False;
-- executing against localhost:21000
DROP DATABASE IF EXISTS `test_unsupported_text_compression_695d360a` CASCADE;

SET sync_ddl=False;
-- executing against localhost:21000
CREATE DATABASE `test_unsupported_text_compression_695d360a`;

MainThread: Created database "test_unsupported_text_compression_695d360a" for test ID "metadata/test_partition_metadata.py::TestPartitionMetadataUncompressedTextOnly::()::test_unsupported_text_compression[exec_option: {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'abort_on_error': 1, 'debug_action': None, 'exec_single_node_rows_threshold': 0} | table_format: text/none]"
MainThread: Starting new HTTPS connection (1): impala-cdh5-s3-test.s3.amazonaws.com
-- executing against localhost:21000
create external table test_unsupported_text_compression_695d360a.multi_text_compression like functional.alltypes location 's3a://impala-cdh5-s3-tests3a://impala-cdh5-s3-test/test-warehouse/test_unsupported_text_compression_695d360a.db/multi_text_compression';

Issue Links

• is broken by: IMPALA-6941 Allow loading more text scanner plugins