[HIVE-26231] Generate insert notification events when dynamic partition insert is done on existing partitions

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-2
• Component/s: HiveServer2
• Labels: pull-request-available
• Assignee: Sourabh Badhya
• Reporter: Sourabh Badhya
• Created: 17/May/22 06:16
• Updated: 16/Nov/22 13:50
• Resolved: 18/May/22 08:34

Description

HIVE-24738 introduced a bug which wont allow generation of insert events when dynamic partition insert is done on existing partitions.

The newFiles list used is null because of the following condition - 
https://github.com/apache/hive/blob/8077bb118cb418cae24a46f7155c481bf893da99/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java#L3159

The newFiles is assigned to empty list only when new partitions are created and is not assigned when insert is done on existing partitions. This affects insert events generation for external tables.

Issue Links

• is caused by: HIVE-24738 Reuse committed filelist from directInsert manifest during loadPartition
• links to: GitHub Pull Request #3294