Description
TL;DR: we should have common storage statistics for bytes read and bytes written, and S3A should use them in its instrumentation and have enum names to match.
- in the S3AInputStream we call S3AInstrumentation.StreamStatistics.bytesRead(long), which adds the amount to bytesRead, in a read(), readFully, or forward seek() reading in data
- and in S3AInstrumentation.mergeInputStreamStatistics, that is pulled into streamBytesRead.
- which has a Statistics name of ""stream_bytes_read"
- but that is served up in the Storage statistics as "STREAM_SEEK_BYTES_READ", which is the wrong name.
- and there isn't a common name for the counter across other filesystems.
For now: people can use the wrong name in the enum; we may want to think about retaining it when adding the correct name. And maybe add a @Evolving/@LimitedPrivate scope pair to the enum
Attachments
Issue Links
- Is contained by
-
HADOOP-17271 S3A statistics to support IOStatistics
-
- Resolved
-