[HADOOP-13969] S3A to support commit(path) operation, which commits all pending put commits in a path

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 3.0.0-beta1
• Component/s: fs/s3
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 10/Jan/17 18:49
• Updated: 21/Mar/18 23:58
• Resolved: 06/Dec/17 13:03

Description

as well as creating and saving data with a pending-commit, s3a needs to add the actual commit operation.

this would scan a directory, take its pending commits, read them in and execute them.

issue: what to do on failures?

Issue Links

• is part of: HADOOP-13786 Add S3A committers for zero-rename commits to S3 endpoints