[HADOOP-15161] s3a: Stream and common statistics missing from metrics

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.0
• Target Version/s: 3.1.0
• Assignee: Sean Mackrory
• Reporter: Sean Mackrory
• Created: 05/Jan/18 23:20
• Updated: 12/Feb/18 15:31
• Resolved: 09/Jan/18 18:48

Description

Input stream statistics aren't being passed through to metrics once merged. Also, the following "common statistics" are not being incremented or tracked by metrics:

OP_APPEND
OP_CREATE
OP_CREATE_NON_RECURSIVE
OP_DELETE
OP_GET_CONTENT_SUMMARY
OP_GET_FILE_CHECKSUM
OP_GET_STATUS
OP_MODIFY_ACL_ENTRIES
OP_OPEN
OP_REMOVE_ACL
OP_REMOVE_ACL_ENTRIES
OP_REMOVE_DEFAULT_ACL
OP_SET_ACL
OP_SET_OWNER
OP_SET_PERMISSION
OP_SET_TIMES
OP_TRUNCATE

Most of those make sense, but we can easily add OP_CREATE (and it's non-recursive cousin), OP_DELETE, OP_OPEN.

Issue Links

• is duplicated by: HADOOP-14975 S3AInputStream/OutputStream statistics aren't getting into StorageStatistics