[HADOOP-13569] S3AFastOutputStream to take ProgressListener in file create()

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 2.8.0
• Component/s: fs/s3
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 31/Aug/16 15:31
• Updated: 04/Jan/17 21:29
• Resolved: 01/Sep/16 16:56

Description

For scale testing I'd like more meaningful progress than the Hadoop Progressable offers.

Proposed: having S3AFastOutputStream check to see if the progressable passed in is also an instance of com.amazonaws.event.ProgressListener —and if so, wire it up directly.

This allows tests to directly track state of upload, log it and perhaps even assert on it

Issue Links

• Is contained by: HADOOP-13560 S3ABlockOutputStream to support huge (many GB) file writes