[HADOOP-13760] S3Guard: add delete tracking

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Component/s: fs/s3
• Assignee: Aaron Fabbri
• Reporter: Aaron Fabbri
• Created: 26/Oct/16 03:36
• Updated: 05/Jun/17 18:36
• Resolved: 25/May/17 14:56

Description

Following the S3AFileSystem integration patch in HADOOP-13651, we need to add delete tracking.

Current behavior on delete is to remove the metadata from the MetadataStore. To make deletes consistent, we need to add a isDeleted flag to PathMetadata and check it when returning results from functions like getFileStatus() and listStatus(). In HADOOP-13651, I added TODO comments in most of the places these new conditions are needed. The work does not look too bad.

Issue Links

• depends upon: HADOOP-13651 S3Guard: S3AFileSystem Integration with MetadataStore