Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11165 Scaling so cluster can host 1M regions and beyond (50M regions?)
  3. HBASE-13991

Hierarchical Layout for Humongous Tables

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Add support for humongous tables via a hierarchical layout for regions on filesystem.

      Credit for most of this code goes to Huaiyu Zhu.

      Latest version of the patch is available on the review board: https://reviews.apache.org/r/36029/

      Known limitation of this patch: It does not deal with HFileLinks, which means that humongous tables, as implemented in this patch, would not support snapshots or timeline consistent region replicas feature in their current form. This could be addressed later but we had decided not to implement HFileLink support for the first version.

      Attachments

        1. HumongousTableDoc.pdf
          269 kB
          Ben Lau
        2. HBASE-13991-master.patch
          138 kB
          Ben Lau

        Issue Links

          is related to

          Sub-task - The sub-task of the issue HBASE-14090 Redo FS layout; let go of tables/regions/stores directory hierarchy in DFS

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              benlau Ben Lau
              Votes:
              0 Vote for this issue
              Watchers:
              19 Start watching this issue

              Dates

                Created:
                Updated: