Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-24408

Introduce a general 'local region' to store data on master

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0-alpha-1, 2.3.0
    • Component/s: master
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Introduced a general 'local region' at master side to store the procedure data, etc.

      The hfile of this region will be stored on the root fs while the wal will be stored on the wal fs. This issue supercedes part of the code for HBASE-23326, as now we store the data in 'MasterData' directory instead of 'MasterProcs'.

      The old hfiles will be moved to the global hfile archived directory with the suffix $-masterlocalhfile-$. The wal files will be moved to the global old wal directory with the suffix $masterlocalwal$. The TimeToLiveMasterLocalStoreHFileCleaner and TimeToLiveMasterLocalStoreWALCleaner are configured by default for cleaning the old hfiles and wal files, and the default TTLs are both 7 days.
      Show
      Introduced a general 'local region' at master side to store the procedure data, etc. The hfile of this region will be stored on the root fs while the wal will be stored on the wal fs. This issue supercedes part of the code for HBASE-23326 , as now we store the data in 'MasterData' directory instead of 'MasterProcs'. The old hfiles will be moved to the global hfile archived directory with the suffix $-masterlocalhfile-$. The wal files will be moved to the global old wal directory with the suffix $masterlocalwal$. The TimeToLiveMasterLocalStoreHFileCleaner and TimeToLiveMasterLocalStoreWALCleaner are configured by default for cleaning the old hfiles and wal files, and the default TTLs are both 7 days.

      Description

      We already have a local region to store the procedure data and when implementing HBASE-11288, splittable meta, we are thinking of also storing the data for root table in a local region.

      Now in the patch for HBASE-24388, we introduced another local region to store the data for root table, but maybe it is better to store the procedure data and root table together in a single region(with different families).

      And this should be done before 2.3.0, to prevent shipping the procedure store region out in a release. Set it a blocker for 2.3.0.

      Patch will be available soon.

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              zhangduo Duo Zhang
              Reporter:
              zhangduo Duo Zhang

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment