[OAK-3806] Collect and expose statistics related to BlobStore operations

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.13, 1.4
• Component/s: blob
• Epic Link: Improved Runtime Statistics Collection
• Assignee: Chetan Mehrotra
• Reporter: Chetan Mehrotra
• Created: 18/Dec/15 06:50
• Updated: 08/Oct/19 15:22
• Resolved: 04/Jan/16 04:22

Description

It would be useful to collect some statistics around BlobStore operations like upload size, download size, how frequent uploads are done etc

It should support following features

• Collection across various implementation - For most cases just collecting stats in DataStoreBlobStore and AbstractBlobStore should be sufficient
• Collected stats should be exposed over JMX

Goals

1. What are the number/size of downloads and uploads over period of time - The time series data would help us understand any hot usage time
2. Are there too many repeated download for few blobIds - Later we can use this information to cache such binary content locally and avoid hitting remote stores (specially useful for RDB/Mongo-BlobStore)
3. What is the typical upload and download rate provided by the BlobStore - Using this we can see if it varies, if its too low for Oak operational needs etc

Issue Links

• is related to: OAK-8336 oak-blob-plugins: bundle plugin complains about deprecated inheritance feature
• is related to: OAK-3823 Expose the count maintained by various stats
• relates to: OAK-3805 Add support for Metrics Histogram