[HIVE-18942] ALTER TABLE may generate huge event (with all partitions)

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0
• Component/s: Metastore
• Assignee: Unassigned
• Reporter: Alex Kolbasov
• Created: 13/Mar/18 03:27
• Updated: 13/Mar/18 22:38

Description

ALTER TABLE handler in HiveAlterHandler has this code:

if (isPartitionedTable) {
  parts = msdb.getPartitions(newt.getDbName(), newt.getTableName(), -1);
  MetaStoreListenerNotifier.notifyEvent(transactionalListeners,
          EventMessage.EventType.ADD_PARTITION,
          new AddPartitionEvent(newt, parts, true, handler),
          environmentContext);
}

The problem is that table may contain huge number of partitions and the event will contain all of them. Partition object itself isn't very small either, so we may end up with huge events which would be stored and then transmitted over the wire to consumers.

spena kkalyan lina.li vaidyand FYI.