Details
Minor Description
Currently we have the following metrics for datanode reads.
| BytesRead BlocksRead TotalReadTime |
Total number of bytes read from DataNode Total number of blocks read from DataNode Total number of milliseconds spent on read operation |
We would like to add a new quantile metric calculating the transfer rate for datanode reads.
This will give us a distribution across a window of the read transfer rate for each datanode.
Quantiles for transfer rate per host will help in identifying issues like hotspotting of datasets as well as finding repetitive slow datanodes.
Attachments
Issue Links
- links to