[HBASE-24408] Introduce a general 'local region' to store data on master

• Type: Task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 3.0.0-alpha-1, 2.3.0
• Component/s: master
• Hadoop Flags: Reviewed

Release Note

Introduced a general 'local region' at master side to store the procedure data, etc.

The hfile of this region will be stored on the root fs while the wal will be stored on the wal fs. This issue supercedes part of the code for HBASE-23326, as now we store the data in 'MasterData' directory instead of 'MasterProcs'.

The old hfiles will be moved to the global hfile archived directory with the suffix $-masterlocalhfile-$. The wal files will be moved to the global old wal directory with the suffix $masterlocalwal$. The TimeToLiveMasterLocalStoreHFileCleaner and TimeToLiveMasterLocalStoreWALCleaner are configured by default for cleaning the old hfiles and wal files, and the default TTLs are both 7 days.

• Assignee: Duo Zhang
• Reporter: Duo Zhang
• Created: 21/May/20 06:20
• Updated: 06/May/22 04:07
• Resolved: 23/May/20 08:46

Description

We already have a local region to store the procedure data and when implementing HBASE-11288, splittable meta, we are thinking of also storing the data for root table in a local region.

Now in the patch for HBASE-24388, we introduced another local region to store the data for root table, but maybe it is better to store the procedure data and root table together in a single region(with different families).

And this should be done before 2.3.0, to prevent shipping the procedure store region out in a release. Set it a blocker for 2.3.0.

Patch will be available soon.

Issue Links

• is related to: HBASE-24388 Store the locations of meta regions in master local store
• is related to: HBASE-23326 Implement a ProcedureStore which stores procedures in a HRegion
• links to: GitHub Pull Request #1753
• links to: PR1753