[HIVE-2907] Hive error when dropping a table with large number of partitions

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.9.0
• Fix Version/s: 0.10.0
• Component/s: Metastore
• Labels: TODOC10

Environment

General. Hive Metastore bug.

• Assignee: Mousom Dhar Gupta Assign to me
• Reporter: Mousom Dhar Gupta
• Created: 26/Mar/12 18:18
• Updated: 03/Oct/15 07:56
• Resolved: 10/Apr/12 16:56

Description

Running into an "Out Of Memory" error when trying to drop a table with 128K partitions.

The methods dropTable in metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java
and dropTable in ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java encounter out of memory errors
when dropping tables with lots of partitions because they try to load the metadata for every partition into memory.