[HIVE-17856] MM tables - IOW is not ACID compliant

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0
• Component/s: Transactions
• Labels: mm-gap-1
• Assignee: Steve Yeom
• Reporter: Sergey Shelukhin
• Created: 19/Oct/17 23:07
• Updated: 22/May/18 23:13
• Resolved: 02/Dec/17 02:41

Description

The following tests were removed from mm_all during "integration"... I should have never allowed such manner of intergration.
MM logic should have been kept intact until ACID logic could catch up. Alas, here we are.

drop table iow0_mm;
create table iow0_mm(key int) tblproperties("transactional"="true", "transactional_properties"="insert_only");
insert overwrite table iow0_mm select key from intermediate;
insert into table iow0_mm select key + 1 from intermediate;
select * from iow0_mm order by key;
insert overwrite table iow0_mm select key + 2 from intermediate;
select * from iow0_mm order by key;
drop table iow0_mm;


drop table iow1_mm; 
create table iow1_mm(key int) partitioned by (key2 int)  tblproperties("transactional"="true", "transactional_properties"="insert_only");
insert overwrite table iow1_mm partition (key2)
select key as k1, key from intermediate union all select key as k1, key from intermediate;
insert into table iow1_mm partition (key2)
select key + 1 as k1, key from intermediate union all select key as k1, key from intermediate;
select * from iow1_mm order by key, key2;
insert overwrite table iow1_mm partition (key2)
select key + 3 as k1, key from intermediate union all select key + 4 as k1, key from intermediate;
select * from iow1_mm order by key, key2;
insert overwrite table iow1_mm partition (key2)
select key + 3 as k1, key + 3 from intermediate union all select key + 2 as k1, key + 2 from intermediate;
select * from iow1_mm order by key, key2;
drop table iow1_mm;

drop table simple_mm;
create table simple_mm(key int) stored as orc tblproperties ("transactional"="true", "transactional_properties"="insert_only");
insert into table simple_mm select key from intermediate;
-insert overwrite table simple_mm select key from intermediate;

Issue Links

• is related to: HIVE-18589 java.io.IOException: Not enough history available
• relates to: HIVE-17970 MM LOAD DATA with OVERWRITE doesn't use base_n directory concept
• links to: https://reviews.apache.org/r/63681/