Details
-
Bug
-
Status: Resolved
-
Blocker
-
Resolution: Fixed
-
Impala 2.12.0
-
None
-
ghx-label-6
Description
Assigning to Vuk, who authored this test as part of the patch for IMPALA-6488:
https://gerrit.cloudera.org/c/9626/
I'm not sure that this really the same failure though, so I'm not reopening that earlier JIRA. If I'm mistaken, please feel free to reopen/reassign as necessary.
Stacktrace
query_test/test_udfs.py:377: in test_native_functions_race assert len(errors) == 0 E assert 1 == 0 E + where 1 = len([ImpalaBeeswaxException()]) Standard Output ImpalaBeeswaxException: INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'> MESSAGE: ImpalaRuntimeException: Error making 'alterDatabase' RPC to Hive Metastore: CAUSED BY: NoSuchObjectException: test_native_functions_race_fc9680e5: Transaction rolled back due to failure during commit
Standard Error
SET sync_ddl=False; -- executing against localhost:21000 DROP DATABASE IF EXISTS `test_native_functions_race_fc9680e5` CASCADE; SET sync_ddl=False; -- executing against localhost:21000 CREATE DATABASE `test_native_functions_race_fc9680e5`; MainThread: Created database "test_native_functions_race_fc9680e5" for test ID "query_test/test_udfs.py::TestUdfExecution::()::test_native_functions_race[exec_option: {'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'exec_single_node_rows_threshold': 0, 'enable_expr_rewrites': True} | table_format: text/none]" -- connecting to: localhost:21000 -- executing against localhost:21000 create function test_native_functions_race_fc9680e5.use_it(string) returns string LOCATION '/test-warehouse/libTestUdfs.so' SYMBOL='_Z8IdentityPN10impala_udf15FunctionContextERKNS_9StringValE';
From catalogd log:
I0420 14:54:00.014191 19585 jni-util.cc:230] org.apache.impala.common.ImpalaRuntimeException: Error making 'alterDatabase' RPC to Hive Metastore: at org.apache.impala.service.CatalogOpExecutor.applyAlterDatabase(CatalogOpExecutor.java:2770) at org.apache.impala.service.CatalogOpExecutor.dropFunction(CatalogOpExecutor.java:1521) at org.apache.impala.service.CatalogOpExecutor.execDdlRequest(CatalogOpExecutor.java:307) at org.apache.impala.service.JniCatalog.execDdl(JniCatalog.java:146) Caused by: NoSuchObjectException(message:test_native_functions_race_fc9680e5: Transaction rolled back due to failure during commit) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$alter_database_result$alter_database_resultStandardScheme.read(ThriftHiveMetastore.java:20111) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$alter_database_result$alter_database_resultStandardScheme.read(ThriftHiveMetastore.java:20088) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$alter_database_result.read(ThriftHiveMetastore.java:20030) at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:86) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_alter_database(ThriftHiveMetastore.java:814) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.alter_database(ThriftHiveMetastore.java:800) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.alterDatabase(HiveMetaStoreClient.java:1420) at sun.reflect.GeneratedMethodAccessor33.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:101) at com.sun.proxy.$Proxy5.alterDatabase(Unknown Source) at org.apache.impala.service.CatalogOpExecutor.applyAlterDatabase(CatalogOpExecutor.java:2768) ... 3 more I0420 14:54:01.581200 3230 catalog-server.cc:245] A catalog update with 5 entries is assembled. Catalog version: 14385 Last sent catalog version: 14377 I0420 14:54:01.582358 3225 catalog-server.cc:480] Collected deletion: FUNCTION:TFunctionName(db_name:test_native_functions_race_fc9680e5, function_name:other)(other(FLOAT)), version=14387, original size=310, compressed size=265 I0420 14:54:01.582433 3225 catalog-server.cc:480] Collected deletion: FUNCTION:TFunctionName(db_name:test_native_functions_race_fc9680e5, function_name:other)(other(FLOAT)), version=14389, original size=310, compressed size=265 I0420 14:54:01.582499 3225 catalog-server.cc:480] Collected deletion: FUNCTION:TFunctionName(db_name:test_native_functions_race_fc9680e5, function_name:other)(other(FLOAT)), version=14391, original size=310, compressed size=265 I0420 14:54:01.582567 3225 catalog-server.cc:480] Collected deletion: FUNCTION:TFunctionName(db_name:test_native_functions_race_fc9680e5, function_name:other)(other(FLOAT)), version=14393, original size=310, compressed size=265 I0420 14:54:01.582693 3225 catalog-server.cc:480] Collected update: CATALOG_SERVICE_ID, version=14393, original size=49, compressed size=52 I0420 14:54:02.267000 19585 status.cc:125] ImpalaRuntimeException: Error making 'alterDatabase' RPC to Hive Metastore: CAUSED BY: NoSuchObjectException: test_native_functions_race_fc9680e5: Transaction rolled back due to failure during commit @ 0x167cca9 impala::Status::Status() @ 0x1adfe5a impala::JniUtil::GetJniExceptionMsg() @ 0x166d348 impala::JniUtil::CallJniMethod<>() @ 0x166b455 impala::Catalog::ExecDdl() @ 0x163781c CatalogServiceThriftIf::ExecDdl() @ 0x16a7032 impala::CatalogServiceProcessor::process_ExecDdl() @ 0x16a6d80 impala::CatalogServiceProcessor::dispatchCall() @ 0x1621660 apache::thrift::TDispatchProcessor::process() @ 0x17fc929 apache::thrift::server::TAcceptQueueServer::Task::run() @ 0x17f43cb impala::ThriftThread::RunRunnable() @ 0x17f5acf boost::_mfi::mf2<>::operator()() @ 0x17f5965 boost::_bi::list3<>::operator()<>() @ 0x17f56b1 boost::_bi::bind_t<>::operator()() @ 0x17f55c4 boost::detail::function::void_function_obj_invoker0<>::invoke() @ 0x1839fcc boost::function0<>::operator()() @ 0x1b4c951 impala::Thread::SuperviseThread() @ 0x1b54e27 boost::_bi::list5<>::operator()<>() @ 0x1b54d4b boost::_bi::bind_t<>::operator()() @ 0x1b54d0e boost::detail::thread_data<>::run() @ 0x2ddd06a thread_proxy @ 0x351c607851 (unknown) @ 0x351c2e894d (unknown) E0420 14:54:02.267047 19585 catalog-server.cc:72] ImpalaRuntimeException: Error making 'alterDatabase' RPC to Hive Metastore: CAUSED BY: NoSuchObjectException: test_native_functions_race_fc9680e5: Transaction rolled back due to failure during commit