[HIVE-24428] Concurrent add_partitions requests may lead to data loss

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Labels: pull-request-available
• Assignee: Zoltan Haindrich
• Reporter: Zoltan Haindrich
• Created: 25/Nov/20 13:30
• Updated: 20/Jan/21 09:59
• Resolved: 20/Jan/21 09:59

Description

in case multiple clients are adding partitions to the same table - when the same partition is being added there is a chance that the data dir is removed after the other client have already written its data

https://github.com/apache/hive/blob/5e96b14a2357c66a0640254d5414bc706d8be852/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java#L3958

Issue Links

• relates to: HIVE-20725 Simultaneous dynamic inserts can result in partition files lost
• links to: GitHub Pull Request #1724