Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-6902

query_test.test_udfs.TestUdfExecution.test_native_functions_race failed during core/thrift build

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • Impala 2.12.0
    • Impala 2.13.0, Impala 3.1.0
    • Backend
    • None
    • ghx-label-6

    Description

      Assigning to Vuk, who authored this test as part of the patch for IMPALA-6488:

      https://gerrit.cloudera.org/c/9626/

      I'm not sure that this really the same failure though, so I'm not reopening that earlier JIRA. If I'm mistaken, please feel free to reopen/reassign as necessary.

      Stacktrace

      query_test/test_udfs.py:377: in test_native_functions_race
       assert len(errors) == 0
      E assert 1 == 0
      E + where 1 = len([ImpalaBeeswaxException()])
      Standard Output
      ImpalaBeeswaxException:
       INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
       MESSAGE: ImpalaRuntimeException: Error making 'alterDatabase' RPC to Hive Metastore: 
      CAUSED BY: NoSuchObjectException: test_native_functions_race_fc9680e5: Transaction rolled back due to failure during commit
      

      Standard Error

      SET sync_ddl=False;
      -- executing against localhost:21000
      DROP DATABASE IF EXISTS `test_native_functions_race_fc9680e5` CASCADE;
      SET sync_ddl=False;
      -- executing against localhost:21000
      CREATE DATABASE `test_native_functions_race_fc9680e5`;
      MainThread: Created database "test_native_functions_race_fc9680e5" for test ID "query_test/test_udfs.py::TestUdfExecution::()::test_native_functions_race[exec_option: {'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'exec_single_node_rows_threshold': 0, 'enable_expr_rewrites': True} | table_format: text/none]"
      -- connecting to: localhost:21000
      -- executing against localhost:21000
      create function test_native_functions_race_fc9680e5.use_it(string) returns string
       LOCATION '/test-warehouse/libTestUdfs.so'
       SYMBOL='_Z8IdentityPN10impala_udf15FunctionContextERKNS_9StringValE';
      

      From catalogd log: 

      I0420 14:54:00.014191 19585 jni-util.cc:230] org.apache.impala.common.ImpalaRuntimeException: Error making 'alterDatabase' RPC to Hive Metastore:
              at org.apache.impala.service.CatalogOpExecutor.applyAlterDatabase(CatalogOpExecutor.java:2770)
              at org.apache.impala.service.CatalogOpExecutor.dropFunction(CatalogOpExecutor.java:1521)
              at org.apache.impala.service.CatalogOpExecutor.execDdlRequest(CatalogOpExecutor.java:307)
              at org.apache.impala.service.JniCatalog.execDdl(JniCatalog.java:146)
      Caused by: NoSuchObjectException(message:test_native_functions_race_fc9680e5: Transaction rolled back due to failure during commit)
              at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$alter_database_result$alter_database_resultStandardScheme.read(ThriftHiveMetastore.java:20111)
              at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$alter_database_result$alter_database_resultStandardScheme.read(ThriftHiveMetastore.java:20088)
              at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$alter_database_result.read(ThriftHiveMetastore.java:20030)
              at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:86)
              at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_alter_database(ThriftHiveMetastore.java:814)
              at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.alter_database(ThriftHiveMetastore.java:800)
              at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.alterDatabase(HiveMetaStoreClient.java:1420)
              at sun.reflect.GeneratedMethodAccessor33.invoke(Unknown Source)
              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.lang.reflect.Method.invoke(Method.java:606)
              at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:101)
              at com.sun.proxy.$Proxy5.alterDatabase(Unknown Source)
              at org.apache.impala.service.CatalogOpExecutor.applyAlterDatabase(CatalogOpExecutor.java:2768)
              ... 3 more
      I0420 14:54:01.581200  3230 catalog-server.cc:245] A catalog update with 5 entries is assembled. Catalog version: 14385 Last sent catalog version: 14377
      I0420 14:54:01.582358  3225 catalog-server.cc:480] Collected deletion: FUNCTION:TFunctionName(db_name:test_native_functions_race_fc9680e5, function_name:other)(other(FLOAT)), version=14387, original size=310, compressed size=265
      I0420 14:54:01.582433  3225 catalog-server.cc:480] Collected deletion: FUNCTION:TFunctionName(db_name:test_native_functions_race_fc9680e5, function_name:other)(other(FLOAT)), version=14389, original size=310, compressed size=265
      I0420 14:54:01.582499  3225 catalog-server.cc:480] Collected deletion: FUNCTION:TFunctionName(db_name:test_native_functions_race_fc9680e5, function_name:other)(other(FLOAT)), version=14391, original size=310, compressed size=265
      I0420 14:54:01.582567  3225 catalog-server.cc:480] Collected deletion: FUNCTION:TFunctionName(db_name:test_native_functions_race_fc9680e5, function_name:other)(other(FLOAT)), version=14393, original size=310, compressed size=265
      I0420 14:54:01.582693  3225 catalog-server.cc:480] Collected update: CATALOG_SERVICE_ID, version=14393, original size=49, compressed size=52
      I0420 14:54:02.267000 19585 status.cc:125] ImpalaRuntimeException: Error making 'alterDatabase' RPC to Hive Metastore:
      CAUSED BY: NoSuchObjectException: test_native_functions_race_fc9680e5: Transaction rolled back due to failure during commit
          @          0x167cca9  impala::Status::Status()
          @          0x1adfe5a  impala::JniUtil::GetJniExceptionMsg()
          @          0x166d348  impala::JniUtil::CallJniMethod<>()
          @          0x166b455  impala::Catalog::ExecDdl()
          @          0x163781c  CatalogServiceThriftIf::ExecDdl()
          @          0x16a7032  impala::CatalogServiceProcessor::process_ExecDdl()
          @          0x16a6d80  impala::CatalogServiceProcessor::dispatchCall()
          @          0x1621660  apache::thrift::TDispatchProcessor::process()
          @          0x17fc929  apache::thrift::server::TAcceptQueueServer::Task::run()
          @          0x17f43cb  impala::ThriftThread::RunRunnable()
          @          0x17f5acf  boost::_mfi::mf2<>::operator()()
          @          0x17f5965  boost::_bi::list3<>::operator()<>()
          @          0x17f56b1  boost::_bi::bind_t<>::operator()()
          @          0x17f55c4  boost::detail::function::void_function_obj_invoker0<>::invoke()
          @          0x1839fcc  boost::function0<>::operator()()
          @          0x1b4c951  impala::Thread::SuperviseThread()
          @          0x1b54e27  boost::_bi::list5<>::operator()<>()
          @          0x1b54d4b  boost::_bi::bind_t<>::operator()()
          @          0x1b54d0e  boost::detail::thread_data<>::run()
          @          0x2ddd06a  thread_proxy
          @       0x351c607851  (unknown)
          @       0x351c2e894d  (unknown)
      E0420 14:54:02.267047 19585 catalog-server.cc:72] ImpalaRuntimeException: Error making 'alterDatabase' RPC to Hive Metastore:
      CAUSED BY: NoSuchObjectException: test_native_functions_race_fc9680e5: Transaction rolled back due to failure during commit
      

       

      Attachments

        Activity

          People

            vukercegovac Vuk Ercegovac
            dknupp David Knupp
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: