Details
-
Bug
-
Status: Resolved
-
Critical
-
Resolution: Duplicate
-
Impala 2.9.0
-
None
Description
TestDdlStatements.test_drop_cleans_hdfs_dirs fails and prints two errors. Since one looks like it fails to create the database while the other one looks like it fails to drop it, I suspect this could be a hidden race around DDL statement synchronization.
dtsirogiannis - I’m assigning this to you thinking you might have an idea what’s going on here; feel free to find another person or assign back to me if you're swamped.
03:37:25.073 ==================================== ERRORS ====================================
03:37:25.074 ______ ERROR at teardown of TestDdlStatements.test_drop_cleans_hdfs_dirs _______
03:37:25.075 [gw1] linux2 -- Python 2.6.6 /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/bin/../infra/python/env/bin/python
03:37:25.075 conftest.py:274: in cleanup
03:37:25.075 {'sync_ddl': sync_ddl})
03:37:25.076 common/impala_test_suite.py:440: in wrapper
03:37:25.076 return function(*args, **kwargs)
03:37:25.076 common/impala_test_suite.py:447: in execute_query_expect_success
03:37:25.076 result = cls.__execute_query(impalad_client, query, query_options)
03:37:25.076 common/impala_test_suite.py:532: in __execute_query
03:37:25.077 return impalad_client.execute(query, user=user)
03:37:25.077 common/impala_connection.py:160: in execute
03:37:25.077 return self.__beeswax_client.execute(sql_stmt, user=user)
03:37:25.077 beeswax/impala_beeswax.py:173: in execute
03:37:25.077 handle = self.__execute_query(query_string.strip(), user=user)
03:37:25.078 beeswax/impala_beeswax.py:337: in __execute_query
03:37:25.078 handle = self.execute_query_async(query_string, user=user)
03:37:25.078 beeswax/impala_beeswax.py:333: in execute_query_async
03:37:25.078 return self.__do_rpc(lambda: self.imp_service.query(query,))
03:37:25.079 beeswax/impala_beeswax.py:458: in __do_rpc
03:37:25.079 raise ImpalaBeeswaxException(self.__build_error_message(b), b)
03:37:25.079 E ImpalaBeeswaxException: ImpalaBeeswaxException:
03:37:25.079 E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
03:37:25.080 E MESSAGE:
03:37:25.080 E ImpalaRuntimeException: Error making 'dropDatabase' RPC to Hive Metastore:
03:37:25.080 E CAUSED BY: NoSuchObjectException: test_drop_cleans_hdfs_dirs_fdfd4f8
03:37:25.081 ---------------------------- Captured stderr setup -----------------------------
03:37:25.081 SET sync_ddl=False;
03:37:25.081 -- executing against localhost:21000
03:37:25.081 DROP DATABASE IF EXISTS `test_drop_cleans_hdfs_dirs_fdfd4f8` CASCADE;
03:37:25.081
03:37:25.081 SET sync_ddl=False;
03:37:25.082 -- executing against localhost:21000
03:37:25.082 CREATE DATABASE `test_drop_cleans_hdfs_dirs_fdfd4f8`;
03:37:25.082
03:37:25.082 MainThread: Created database "test_drop_cleans_hdfs_dirs_fdfd4f8" for test ID "metadata/test_ddl.py::TestDdlStatements::()::test_drop_cleans_hdfs_dirs"
03:37:25.083 ----------------------------- Captured stderr call -----------------------------
03:37:25.083 -- executing against localhost:21000
03:37:25.083 use default;
03:37:25.083
03:37:25.083 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.084 -- executing against localhost:21000
03:37:25.084 create table test_drop_cleans_hdfs_dirs_fdfd4f8.t1(i int);
03:37:25.084
03:37:25.084 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.084 -- executing against localhost:21000
03:37:25.084 drop table test_drop_cleans_hdfs_dirs_fdfd4f8.t1;
03:37:25.084
03:37:25.084 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.085 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.085 -- executing against localhost:21000
03:37:25.085 drop database test_drop_cleans_hdfs_dirs_fdfd4f8;
03:37:25.085
03:37:25.085 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.085 -- connecting to: localhost:21000
03:37:25.085 -- executing against localhost:21000
03:37:25.086 create database test_drop_cleans_hdfs_dirs_fdfd4f8 location '/test-warehouse/test_drop_cleans_hdfs_dirs_fdfd4f8.db';
03:37:25.086
03:37:25.086 -- closing connection to: localhost:21000
03:37:25.086 -- executing against localhost:21000
03:37:25.086 create table test_drop_cleans_hdfs_dirs_fdfd4f8.t1(i int);
03:37:25.086
03:37:25.086 -- executing against localhost:21000
03:37:25.086 create table test_drop_cleans_hdfs_dirs_fdfd4f8.t2(i int);
03:37:25.087
03:37:25.087 -- executing against localhost:21000
03:37:25.087 create external table test_drop_cleans_hdfs_dirs_fdfd4f8.t3(i int) location '/test-warehouse/test_drop_cleans_hdfs_dirs_fdfd4f8/t3/';
03:37:25.087
03:37:25.087 -- executing against localhost:21000
03:37:25.087 drop database test_drop_cleans_hdfs_dirs_fdfd4f8 cascade;
03:37:25.088
03:37:25.088 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.088 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.088 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.088 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.089 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.089 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.089 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.089 -- connecting to: localhost:21000
03:37:25.089 -- executing against localhost:21000
03:37:25.090 create database test_drop_cleans_hdfs_dirs_fdfd4f8 location '/test-warehouse/test_drop_cleans_hdfs_dirs_fdfd4f8.db';
03:37:25.090
03:37:25.091 --------------------------- Captured stderr teardown ---------------------------
03:37:25.091 -- executing against localhost:21000
03:37:25.091 use default;
03:37:25.092
03:37:25.092 SET sync_ddl=False;
03:37:25.092 -- executing against localhost:21000
03:37:25.092 DROP DATABASE `test_drop_cleans_hdfs_dirs_fdfd4f8` CASCADE;
03:37:25.092
03:37:25.093 =================================== FAILURES ===================================
03:37:25.093 _________________ TestDdlStatements.test_drop_cleans_hdfs_dirs _________________
03:37:25.094 [gw1] linux2 -- Python 2.6.6 /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/bin/../infra/python/env/bin/python
03:37:25.095 metadata/test_ddl.py:130: in test_drop_cleans_hdfs_dirs
03:37:25.095 self._create_db(unique_database)
03:37:25.095 metadata/test_ddl_base.py:64: in _create_db
03:37:25.095 impala_client.execute(ddl)
03:37:25.095 common/impala_connection.py:160: in execute
03:37:25.096 return self.__beeswax_client.execute(sql_stmt, user=user)
03:37:25.096 beeswax/impala_beeswax.py:173: in execute
03:37:25.096 handle = self.__execute_query(query_string.strip(), user=user)
03:37:25.096 beeswax/impala_beeswax.py:337: in __execute_query
03:37:25.096 handle = self.execute_query_async(query_string, user=user)
03:37:25.097 beeswax/impala_beeswax.py:333: in execute_query_async
03:37:25.097 return self.__do_rpc(lambda: self.imp_service.query(query,))
03:37:25.097 beeswax/impala_beeswax.py:458: in __do_rpc
03:37:25.097 raise ImpalaBeeswaxException(self.__build_error_message(b), b)
03:37:25.097 E ImpalaBeeswaxException: ImpalaBeeswaxException:
03:37:25.098 E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
03:37:25.098 E MESSAGE: AnalysisException: Database already exists: test_drop_cleans_hdfs_dirs_fdfd4f8
03:37:25.099 ---------------------------- Captured stderr setup -----------------------------
03:37:25.099 SET sync_ddl=False;
03:37:25.099 -- executing against localhost:21000
03:37:25.099 DROP DATABASE IF EXISTS `test_drop_cleans_hdfs_dirs_fdfd4f8` CASCADE;
03:37:25.099
03:37:25.099 SET sync_ddl=False;
03:37:25.099 -- executing against localhost:21000
03:37:25.100 CREATE DATABASE `test_drop_cleans_hdfs_dirs_fdfd4f8`;
03:37:25.100
03:37:25.100 MainThread: Created database "test_drop_cleans_hdfs_dirs_fdfd4f8" for test ID "metadata/test_ddl.py::TestDdlStatements::()::test_drop_cleans_hdfs_dirs"
03:37:25.101 ----------------------------- Captured stderr call -----------------------------
03:37:25.101 -- executing against localhost:21000
03:37:25.101 use default;
03:37:25.101
03:37:25.101 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.101 -- executing against localhost:21000
03:37:25.102 create table test_drop_cleans_hdfs_dirs_fdfd4f8.t1(i int);
03:37:25.102
03:37:25.102 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.102 -- executing against localhost:21000
03:37:25.102 drop table test_drop_cleans_hdfs_dirs_fdfd4f8.t1;
03:37:25.102
03:37:25.102 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.102 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.102 -- executing against localhost:21000
03:37:25.103 drop database test_drop_cleans_hdfs_dirs_fdfd4f8;
03:37:25.103
03:37:25.103 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.103 -- connecting to: localhost:21000
03:37:25.103 -- executing against localhost:21000
03:37:25.103 create database test_drop_cleans_hdfs_dirs_fdfd4f8 location '/test-warehouse/test_drop_cleans_hdfs_dirs_fdfd4f8.db';
03:37:25.103
03:37:25.103 -- closing connection to: localhost:21000
03:37:25.103 -- executing against localhost:21000
03:37:25.104 create table test_drop_cleans_hdfs_dirs_fdfd4f8.t1(i int);
03:37:25.104
03:37:25.104 -- executing against localhost:21000
03:37:25.104 create table test_drop_cleans_hdfs_dirs_fdfd4f8.t2(i int);
03:37:25.104
03:37:25.104 -- executing against localhost:21000
03:37:25.104 create external table test_drop_cleans_hdfs_dirs_fdfd4f8.t3(i int) location '/test-warehouse/test_drop_cleans_hdfs_dirs_fdfd4f8/t3/';
03:37:25.104
03:37:25.104 -- executing against localhost:21000
03:37:25.105 drop database test_drop_cleans_hdfs_dirs_fdfd4f8 cascade;
03:37:25.105
03:37:25.105 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.105 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.105 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.105 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.105 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.105 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.106 MainThread: Starting new HTTP connection (1): 0.0.0.0
03:37:25.106 -- connecting to: localhost:21000
03:37:25.106 -- executing against localhost:21000
03:37:25.106 create database test_drop_cleans_hdfs_dirs_fdfd4f8 location '/test-warehouse/test_drop_cleans_hdfs_dirs_fdfd4f8.db';