[HADOOP-11520] Clean incomplete multi-part uploads in S3A tests

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.6.0
• Fix Version/s: 2.7.0
• Component/s: fs/s3
• Assignee: Thomas Demoor
• Reporter: Thomas Demoor
• Created: 29/Jan/15 15:50
• Updated: 24/Apr/15 22:48
• Resolved: 06/Feb/15 21:02

Description

As proposed in HADOOP-11488. This patch activates the purging functionality of s3a at the start of each test. This cleans up any in-progress multi-part uploads in the test bucket, preventing unknowing users from eternally paying Amazon for the space of the already uploaded parts of previous tests that failed during a multi-part upload.

People who have run the s3a tests should run a single test (evidently after this patch is applied) against all their testbuckets (or manually abort multipart).

Issue Links

• depends upon: HADOOP-11488 Difference in default connection timeout for S3A FS
• is depended upon by: HADOOP-11571 Über-jira: S3a stabilisation phase I