[HUDI-135] Skip Meta folder when looking for partitions

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Component/s: Common Core
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Balaji Varadarajan
• Created: 28/May/19 20:57
• Updated: 29/May/19 22:13
• Resolved: 29/May/19 22:13

Description

Currently, cleaner, Rollback and compaction-scheduling logic is recursively listing all subfolders including that of ".hoodie" when looking for partition-paths.  This causes a race when they try to list all folders (recursively) but the marker directory (that of compaction inside of ".hoodie" folder) is deleted underneath by compactor.

Issue Links

• links to: GitHub Pull Request #698