[SPARK-15348] Hive ACID

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 1.6.3, 2.0.2, 2.1.2, 2.2.0, 2.3.0
• Component/s: SQL
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Ran Haim
• Created: 16/May/16 14:57
• Updated: 25/May/21 01:54
• Resolved: 25/May/21 01:43

Description

Spark does not support any feature of hive's transnational tables,
you cannot use spark to delete/update a table and it also has problems reading the aggregated data when no compaction was done.
Also it seems that compaction is not supported - alter table ... partition .... COMPACT 'major'

Issue Links

• relates to: HIVE-14035 Enable predicate pushdown to delta files created by ACID Transactions
• relates to: HIVE-17089 make acid 2.0 the default