[IMPALA-12266] Sporadic failure after migrating a table to Iceberg

• Type: Bug
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: Impala 4.2.0
• Component/s: Frontend, Test
• Labels: impala-iceberg
• Epic Color: ghx-label-6
• Assignee: Gabor Kaszab
• Reporter: Tamas Mate
• Created: 05/Jul/23 07:38
• Updated: 13/Aug/24 21:49

Description

TestIcebergTable.test_convert_table test failed in a recent verify job's dockerised tests:
https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests/7629

E   ImpalaBeeswaxException: ImpalaBeeswaxException:
E    INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
E    MESSAGE: AnalysisException: Failed to load metadata for table: 'parquet_nopartitioned'
E   CAUSED BY: TableLoadingException: Could not load table test_convert_table_cdba7383.parquet_nopartitioned from catalog
E   CAUSED BY: TException: TGetPartialCatalogObjectResponse(status:TStatus(status_code:GENERAL, error_msgs:[NullPointerException: null]), lookup_status:OK)

E0704 19:09:22.980131   833 JniUtil.java:183] 7145c21173f2c47b:2579db5500000000] Error in Getting partial catalog object of TABLE:test_convert_table_cdba7383.parquet_nopartitioned. Time spent: 49ms
I0704 19:09:22.980309   833 jni-util.cc:288] 7145c21173f2c47b:2579db5500000000] java.lang.NullPointerException
	at org.apache.impala.catalog.CatalogServiceCatalog.replaceTableIfUnchanged(CatalogServiceCatalog.java:2357)
	at org.apache.impala.catalog.CatalogServiceCatalog.getOrLoadTable(CatalogServiceCatalog.java:2300)
	at org.apache.impala.catalog.CatalogServiceCatalog.doGetPartialCatalogObject(CatalogServiceCatalog.java:3587)
	at org.apache.impala.catalog.CatalogServiceCatalog.getPartialCatalogObject(CatalogServiceCatalog.java:3513)
	at org.apache.impala.catalog.CatalogServiceCatalog.getPartialCatalogObject(CatalogServiceCatalog.java:3480)
	at org.apache.impala.service.JniCatalog.lambda$getPartialCatalogObject$11(JniCatalog.java:397)
	at org.apache.impala.service.JniCatalogOp.lambda$execAndSerialize$1(JniCatalogOp.java:90)
	at org.apache.impala.service.JniCatalogOp.execOp(JniCatalogOp.java:58)
	at org.apache.impala.service.JniCatalogOp.execAndSerialize(JniCatalogOp.java:89)
	at org.apache.impala.service.JniCatalogOp.execAndSerializeSilentStartAndFinish(JniCatalogOp.java:109)
	at org.apache.impala.service.JniCatalog.execAndSerializeSilentStartAndFinish(JniCatalog.java:238)
	at org.apache.impala.service.JniCatalog.getPartialCatalogObject(JniCatalog.java:396)
I0704 19:09:22.980324   833 status.cc:129] 7145c21173f2c47b:2579db5500000000] NullPointerException: null
    @          0x1012f9f  impala::Status::Status()
    @          0x187f964  impala::JniUtil::GetJniExceptionMsg()
    @           0xfee920  impala::JniCall::Call<>()
    @           0xfccd0f  impala::Catalog::GetPartialCatalogObject()
    @           0xfb55a5  impala::CatalogServiceThriftIf::GetPartialCatalogObject()
    @           0xf7a691  impala::CatalogServiceProcessorT<>::process_GetPartialCatalogObject()
    @           0xf82151  impala::CatalogServiceProcessorT<>::dispatchCall()
    @           0xee330f  apache::thrift::TDispatchProcessor::process()
    @          0x1329246  apache::thrift::server::TAcceptQueueServer::Task::run()
    @          0x1315a89  impala::ThriftThread::RunRunnable()
    @          0x131773d  boost::detail::function::void_function_obj_invoker0<>::invoke()
    @          0x195ba8c  impala::Thread::SuperviseThread()
    @          0x195c895  boost::detail::thread_data<>::run()
    @          0x23a03a7  thread_proxy
    @     0x7faaad2a66ba  start_thread
    @     0x7faaaa2c151d  clone
E0704 19:09:23.006968   833 catalog-server.cc:278] 7145c21173f2c47b:2579db5500000000] NullPointerException: null

Issue Links

• is caused by: IMPALA-12712 INVALIDATE METADATA <table> should set a better createEventId
• is duplicated by: IMPALA-13013 Table not found after CONVERT TO ICEBERG in load-data