Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
3.0.0
-
None
-
None
Description
This is necessary for correctness since each add partition consists of 2 parts
- Add Partition metadata object to metastore
- Create a delta dir and copy data there.
This means it's neither Atomic not Isolated. Isolation is fixed by using X lock (which is currently on the table. todo: see if it can be made on the partition being created - this may block table level locks...)
Atomicity would have to be addressed by adding a write ID to Partition to that it's not visible until Hive transaction has committed.
Attachments
Issue Links
- is related to
-
HIVE-19965 Make HiveEndPoint use IMetaStoreClient.add_partition
- Closed
-
HIVE-20436 Lock Manager scalability - linear
- Open