Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
Description
Provide Hadoop metrics showing operational details of the S3Guard implementation.
The metrics will be implemented in this ticket:
● S3GuardRechecksNthPercentileLatency (MutableQuantiles) Percentile time spent
in rechecks attempting to achieve consistency. Repeated for multiple percentile values
of N. This metric is an indicator of the additional latency cost of running S3A with
S3Guard.
● S3GuardRechecksNumOps (MutableQuantiles) Number of times a consistency
recheck was required while attempting to achieve consistency.
● S3GuardStoreNthPercentileLatency (MutableQuantiles) Percentile time spent in
operations against the consistent store, including both write operations during file system
mutations and read operations during file system consistency checks. Repeated for
multiple percentile values of N. This metric is an indicator of latency to the consistent
store implementation.
● S3GuardConsistencyStoreNumOps (MutableQuantiles) Number of operations
against the consistent store, including both write operations during file system mutations
and read operations during file system consistency checks.
● S3GuardConsistencyStoreFailures (MutableCounterLong) Number of failures
during operations against the consistent store implementation.
● S3GuardConsistencyStoreTimeouts (MutableCounterLong) Number of timeouts
during operations against the consistent store implementation.
● S3GuardInconsistencies (MutableCounterLong) C ount of times S3Guard failed to
achieve consistency, even after exhausting all rechecks. A high count may indicate
unexpected outofband modification of the S3 bucket contents, such as by an external
tool that does not make corresponding updates to the consistent store.