[HIVE-26417] Iceberg integration: disable update and merge iceberg table when split update is off

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-2
• Component/s: File Formats
• Labels: pull-request-available
• Assignee: Krisztian Kasa
• Reporter: Krisztian Kasa
• Created: 20/Jul/22 15:47
• Updated: 16/Nov/22 13:50
• Resolved: 22/Jul/22 11:10

Description

Iceberg table update and merge is implemented using split update early by HIVE-26319 and HIVE-26385.

Without split update early deleted records has to be buffered in memory  when updating iceberg tables. With split update early deleted records are processed by a separate reducer and no buffering is required. The ReduceSink operator also sorts the records.

Issue Links

• links to: GitHub Pull Request #3461