Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4583

test_views_ddl failed with "Table already exists" from HMS

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Duplicate
    • Impala 2.8.0
    • None
    • Catalog, Infrastructure

    Description

      Not making this a blocker because the issue only happened once and there were several subsequent green runs of the same job.

      Jenkins console snippet:

      08:59:22 =================================== FAILURES ===================================
08:59:22  TestDdlStatements.test_views_ddl[exec_option: {'batch_size': 0, 'num_nodes': 0, 'sync_ddl': 0, 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: text/none-unique_database0] 
08:59:22 [gw1] linux2 -- Python 2.6.6 /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/bin/../infra/python/env/bin/python
08:59:22 metadata/test_ddl.py:309: in test_views_ddl
08:59:22     multiple_impalad=self._use_multiple_impalad(vector))
08:59:22 common/impala_test_suite.py:324: in run_test_case
08:59:22     result = self.__execute_query(target_impalad_client, query, user=user)
08:59:22 common/impala_test_suite.py:532: in __execute_query
08:59:22     return impalad_client.execute(query, user=user)
08:59:22 common/impala_connection.py:160: in execute
08:59:22     return self.__beeswax_client.execute(sql_stmt, user=user)
08:59:22 beeswax/impala_beeswax.py:173: in execute
08:59:22     handle = self.__execute_query(query_string.strip(), user=user)
08:59:22 beeswax/impala_beeswax.py:337: in __execute_query
08:59:22     handle = self.execute_query_async(query_string, user=user)
08:59:22 beeswax/impala_beeswax.py:333: in execute_query_async
08:59:22     return self.__do_rpc(lambda: self.imp_service.query(query,))
08:59:22 beeswax/impala_beeswax.py:458: in __do_rpc
08:59:22     raise ImpalaBeeswaxException(self.__build_error_message(b), b)
08:59:22 E   ImpalaBeeswaxException: ImpalaBeeswaxException:
08:59:22 E    INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
08:59:22 E    MESSAGE: 
08:59:22 E   ImpalaRuntimeException: Error making 'createTable' RPC to Hive Metastore: 
08:59:22 E   CAUSED BY: AlreadyExistsException: Table hints_test already exists
08:59:22 ---------------------------- Captured stderr setup -----------------------------
08:59:22 SET sync_ddl=True;
08:59:22 -- executing against localhost:21000
08:59:22 DROP DATABASE IF EXISTS `test_views_ddl_cad234c7` CASCADE;
08:59:22 
08:59:22 SET sync_ddl=True;
08:59:22 -- executing against localhost:21000
08:59:22 CREATE DATABASE `test_views_ddl_cad234c7`;
08:59:22 
08:59:22 MainThread: Created database "test_views_ddl_cad234c7" for test ID "metadata/test_ddl.py::TestDdlStatements::()::test_views_ddl[exec_option: {'batch_size': 0, 'num_nodes': 0, 'sync_ddl': 0, 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: text/none-unique_database0]"
08:59:22 ----------------------------- Captured stderr call -----------------------------
08:59:22 -- executing against localhost:21000
08:59:22 use test_views_ddl_cad234c7;
08:59:22 
08:59:22 SET batch_size=0;
08:59:22 SET num_nodes=0;
08:59:22 SET sync_ddl=0;
08:59:22 SET disable_codegen=False;
08:59:22 SET abort_on_error=False;
08:59:22 SET exec_single_node_rows_threshold=0;
08:59:22 -- executing against localhost:21000
08:59:22 create view test_views_ddl_cad234c7.simple_view as
08:59:22 select * from functional.alltypes;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 create view if not exists test_views_ddl_cad234c7.simple_view as
08:59:22 select * from functional.alltypesagg;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 create view if not exists
08:59:22 test_views_ddl_cad234c7.simple_view_sub (x, y comment 'hello', z) as
08:59:22 select int_col, string_col, timestamp_col from functional.alltypes;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 create view test_views_ddl_cad234c7.parquet_view as
08:59:22 select * from functional_parquet.alltypes where id < 20;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 create view test_views_ddl_cad234c7.complex_view (abc comment 'agg', xyz comment 'gby') as
08:59:22 select count(a.bigint_col), b.string_col from
08:59:22 functional.alltypesagg a inner join functional.alltypestiny b
08:59:22 on a.id = b.id where a.bigint_col < 50
08:59:22 group by b.string_col having count(a.bigint_col) > 1
08:59:22 order by b.string_col limit 100;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 create view test_views_ddl_cad234c7.view_view (aaa, bbb) as
08:59:22 select * from test_views_ddl_cad234c7.complex_view;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 show tables in test_views_ddl_cad234c7;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 describe test_views_ddl_cad234c7.simple_view;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 describe test_views_ddl_cad234c7.simple_view_sub;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 describe test_views_ddl_cad234c7.complex_view;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 describe test_views_ddl_cad234c7.parquet_view;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 describe test_views_ddl_cad234c7.view_view;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 select count(*) from test_views_ddl_cad234c7.simple_view;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 select count(*) from test_views_ddl_cad234c7.simple_view_sub;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 select count(*) from test_views_ddl_cad234c7.complex_view;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 select count(*) from test_views_ddl_cad234c7.parquet_view;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 select count(*) from test_views_ddl_cad234c7.view_view;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 drop view test_views_ddl_cad234c7.simple_view_sub;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 show tables in test_views_ddl_cad234c7;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 drop view if exists test_views_ddl_cad234c7.bad_view;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 create table test_views_ddl_cad234c7.drop_tbl_test(a int);
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 drop view if exists test_views_ddl_cad234c7.drop_tbl_test;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 drop table if exists test_views_ddl_cad234c7.complex_view;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 show tables in test_views_ddl_cad234c7;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 alter view test_views_ddl_cad234c7.view_view rename to test_views_ddl_cad234c7.view_on_view;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 alter view test_views_ddl_cad234c7.parquet_view rename to test_views_ddl_cad234c7.new_parquet_view;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 show tables in test_views_ddl_cad234c7;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 alter view test_views_ddl_cad234c7.new_parquet_view as
08:59:22 select bigint_col, string_col from functional_parquet.alltypesagg
08:59:22 where bigint_col is null limit 10;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 select count(bigint_col), count(string_col) from test_views_ddl_cad234c7.new_parquet_view;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 create view test_views_ddl_cad234c7.const_view
08:59:22 as select 1, 'a', cast(10.0 as float);
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 select * from test_views_ddl_cad234c7.const_view;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 create view test_views_ddl_cad234c7.paren_view as
08:59:22 select count(*) from functional.alltypessmall
08:59:22 where true and (true or false) and false;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 select * from test_views_ddl_cad234c7.paren_view;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 create view test_views_ddl_cad234c7.decimal_view as
08:59:22 select * from functional.decimal_tbl;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 select * from test_views_ddl_cad234c7.decimal_view;
08:59:22 
08:59:22 -- executing against localhost:21000
08:59:22 create view test_views_ddl_cad234c7.hints_test as
08:59:22 select /* +straight_join */ a.* from functional.alltypestiny a
08:59:22 inner join /* +broadcast */ functional.alltypes b on a.id = b.id
08:59:22 inner join /* +shuffle */ functional.alltypessmall c on b.id = c.id;
08:59:22 
08:59:22  generated xml file: /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/logs/ee_tests/results/TEST-impala-parallel.xml 
08:59:22 =========================== short test summary info ============================

      Attachments

        Activity

          People

            Unassigned Unassigned
            alex.behm Alexander Behm
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: