Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-451

Remove HTableDescriptor from HRegionInfo

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.2.0
    • Fix Version/s: 0.92.0
    • Component/s: master, regionserver
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Removes HTableDescriptor from HRegionInfo. Runs a migration of catalog tables on startup.

      Description

      There is an HRegionInfo for every region in HBase. Currently HRegionInfo also contains the HTableDescriptor (the schema). That means we store the schema n times where n is the number of regions in the table.

      Additionally, for every region of the same table that the region server has open, there is a copy of the schema. Thus it is stored in memory once for each open region.

      If HRegionInfo merely contained the table name the HTableDescriptor could be stored in a separate file and easily found.

        Attachments

        1. HBASE-451_-_First_draft_support_for_removing_HTD_from_HRI1.patch
          225 kB
          Subbu M Iyer
        2. 451_support_for_removing_HTD_from_HRI_trunk.txt
          221 kB
          Ted Yu
        3. HBASE-451_-_Second_draft_-_Remove_HTD_from_HRI.patch
          238 kB
          Subbu M Iyer
        4. HBASE-451_-_Fourth_draft_support_for_removing_HTD_from_HRI.patch
          237 kB
          Subbu M Iyer
        5. fixtestadmin.txt
          32 kB
          Michael Stack
        6. HBASE-451-Fixed_broken_TestAdmin.patch
          8 kB
          Subbu M Iyer
        7. HBASE-451-Fixed_broken_TestAdmin1.patch
          2 kB
          Subbu M Iyer
        8. pass_htd_on_region_construction.txt
          45 kB
          Michael Stack
        9. descriptors.txt
          98 kB
          Michael Stack
        10. 451-addendum-v2.txt
          1 kB
          Ted Yu

          Issue Links

            Activity

              People

              • Assignee:
                iamknome Subbu M Iyer
                Reporter:
                jimk Jim Kellerman
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: