[HIVE-18021] Insert overwrite on acid table with Union All optimizations

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0
• Component/s: Transactions
• Target Version/s: 3.0.0
• Assignee: Unassigned
• Reporter: Eugene Koifman
• Created: 08/Nov/17 20:30
• Updated: 15/Aug/18 20:46

Description

This is a followup from HIVE-14988.
T is unbucketed acid table

insert into T select a,b from S union all select a,b from S1

will create a separate subdirectory for each leg of the union in the target table
(automatically on Tez, with some props enabled on MR)
Regular Insert will make each subdirectory be a delta_x_x_0, delta_x_x_1. See HIVE-15899.
There is no such suffix mechanism for base_x/.

Need to figure how this should work.

Issue Links

• is related to: HIVE-18126 IOW Mechanics of multiple commands with OVERWRITE in a singe transactions
• is related to: HIVE-19908 Block Insert Overwrite with Union All on full CRUD ACID tables using HIVE_UNION_SUBDIR_
• relates to: HIVE-15899 Make CTAS with acid target table and insert into acid_tbl select ... union all ... work
• relates to: HIVE-14988 Support INSERT OVERWRITE into a partition on transactional tables