[HADOOP-18698] S3ABlockOutputStream doesn't collect stats on multipart block uploads

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 3.3.5
• Component/s: fs/s3
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 12/Apr/23 18:58
• Updated: 27/Apr/23 10:02
• Resolved: 27/Apr/23 10:02

Description

assertion failures in HADOOP-18695 show that S3ABlockOutputStream isn't collecting stats on how long the individual post calls of multipart uploads: duration or number.
that is despite some counters in the IOStatistics of the stream set up to do this and merge to the FS in close()

Looks like the simplest fix is to instrument the FS to do collect these, rather than in-stream. in stream would be best for context stats

Issue Links

• Is contained by: HADOOP-18695 S3A: reject multipart copy requests when disabled
• relates to: HADOOP-18695 S3A: reject multipart copy requests when disabled