[HIVE-1539] Concurrent metastore threading problem

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.7.0
• Component/s: Metastore
• Release Note: We switched to a datanucleus version >= 2.2 a long time ago so this is fixed.
• Assignee: Bennie Schut
• Reporter: Bennie Schut
• Created: 13/Aug/10 15:36
• Updated: 28/Sep/16 18:58
• Resolved: 05/Jun/14 07:55

Description

When running hive as a service and running a high number of queries concurrently I end up with multiple threads running at 100% cpu without any progress.

Looking at these threads I notice this thread(484e):
at org.apache.hadoop.hive.metastore.ObjectStore.getMTable(ObjectStore.java:598)

But on a different thread(63a2):
at org.apache.hadoop.hive.metastore.model.MStorageDescriptor.jdoReplaceField(MStorageDescriptor.java)

Issue Links

• is related to: HIVE-1853 downgrade JDO version
• is related to: HIVE-1609 Support partition filtering in metastore
• relates to: HIVE-1862 Revive partition filtering in the Hive MetaStore
• relates to: HIVE-1899 add a factory method for creating a synchronized wrapper for IMetaStoreClient