[HADOOP-13845] s3a to instrument duration of HTTP calls

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.9.0
• Fix Version/s: 3.3.1
• Component/s: fs/s3
• Target Version/s: 3.4.0
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 29/Nov/16 16:26
• Updated: 14/Jan/21 13:54
• Resolved: 14/Jan/21 13:54

Description

HADOOP-13844 proposes pulling out the swift duration classes for reuse; this patch proposes instrumenting s3a with it.

One interesting question: what to do with the values. For now, they could just be printed, but it might be interesting to include in FS stats collected at the end of a run. However, those are all assumed to be simple counters where merging is a matter of addition. These are more metrics

Issue Links

• Is contained by: HADOOP-17271 S3A statistics to support IOStatistics