Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-451

Remove HTableDescriptor from HRegionInfo

VotersStop watchingWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.2.0
    • 0.92.0
    • master, regionserver
    • None
    • Incompatible change, Reviewed
    • Removes HTableDescriptor from HRegionInfo. Runs a migration of catalog tables on startup.

    Description

      There is an HRegionInfo for every region in HBase. Currently HRegionInfo also contains the HTableDescriptor (the schema). That means we store the schema n times where n is the number of regions in the table.

      Additionally, for every region of the same table that the region server has open, there is a copy of the schema. Thus it is stored in memory once for each open region.

      If HRegionInfo merely contained the table name the HTableDescriptor could be stored in a separate file and easily found.

      Attachments

        1. 451_support_for_removing_HTD_from_HRI_trunk.txt
          221 kB
          Ted Yu
        2. 451-addendum-v2.txt
          1 kB
          Ted Yu
        3. descriptors.txt
          98 kB
          Michael Stack
        4. fixtestadmin.txt
          32 kB
          Michael Stack
        5. HBASE-451_-_First_draft_support_for_removing_HTD_from_HRI1.patch
          225 kB
          Subbu M Iyer
        6. HBASE-451_-_Fourth_draft_support_for_removing_HTD_from_HRI.patch
          237 kB
          Subbu M Iyer
        7. HBASE-451_-_Second_draft_-_Remove_HTD_from_HRI.patch
          238 kB
          Subbu M Iyer
        8. HBASE-451-Fixed_broken_TestAdmin.patch
          8 kB
          Subbu M Iyer
        9. HBASE-451-Fixed_broken_TestAdmin1.patch
          2 kB
          Subbu M Iyer
        10. pass_htd_on_region_construction.txt
          45 kB
          Michael Stack

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            iamknome Subbu M Iyer
            jimk Jim Kellerman
            Votes:
            0 Vote for this issue
            Watchers:
            7 Stop watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment