[HBASE-27997] Enhance prefetch executor to record region prefetch information along with the list of hfiles prefetched

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.6.0, 3.0.0-alpha-4
• Fix Version/s: 2.6.0, 3.0.0-beta-1
• Component/s: BucketCache
• Assignee: Rahul Agarkar
• Reporter: Rahul Agarkar
• Created: 28/Jul/23 11:03
• Updated: 29/Jan/24 18:45
• Resolved: 26/Dec/23 10:02

Description

HBASE-27313 implemented the prefetch persistence feature where it persists the list of hFiles prefetched in the bucket cache. This information is used to reconstruct the cache in the event of a server restart/crash.

Currently, only the list of hFiles is persisted.

However, for the new PrefetchAwareLoadBalancer (work in progress) to work, we need the information about how much a region is prefetched on a region server.

This Jira introduces an additional map in the prefetch executor to maintain the information about how much a region has been prefetched on that region server. The size of region server prefetched is calculated as the total size of all hFiles prefetched for that region.

Issue Links

• links to: GitHub Pull Request #5339