Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
When dynamic partitions are loaded, Hive::loadDynamicPartition loads all partitions from HMS causing heavy load on it. This becomes worse when large number of partitions are present in tables.
Only relevant partitions being loaded in dynamic partitions can be queried from HMS for partition existence.
Attachments
Issue Links
- is related to
-
HIVE-25178 Reduce number of getPartition calls during loadDynamicPartitions for External Tables
- Resolved
- relates to
-
HIVE-25800 loadDynamicPartitions in Hive.java should not load all partitions of a managed table
- Closed