Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Done
-
3.3.0
-
None
-
None
Description
in deleteSubtree(path), the DynamoDB metastore walks down the tree, returning elements to delete. But it will delete parent entries before children, so if an operation fails partway through, there will be orphans
Better: DescendantsIterator to return all the leaf nodes before their parents so the deletion is done bottom up
Also: push the deletions off into their own async queue/pool so that they don't become the bottleneck on the process