1. HBase
  2. HBASE-5386

[usability] Soft limit for eager region splitting of young tables


    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Usability
    • Labels:


      Coming out of HBASE-2375, we need a new functionality much like hypertable's where we would have a lower split size for new tables and it would grow up to a certain hard limit. This helps usability in different ways:

      • With that we can set the default split size much higher and users will still have good data distribution
      • No more messing with force splits
      • Not mandatory to pre-split your table in order to get good out of the box performance

      The way Doug Judd described how it works for them, they start with a low value and then double it every time it splits. For example if we started with a soft size of 32MB and a hard size of 2GB, it wouldn't be until you have 64 regions that you hit the ceiling.

      On the implementation side, we could add a new qualifier in .META. that has that soft limit. When that field doesn't exist, this feature doesn't kick in. It would be written by the region servers after a split and by the master when the table is created with 1 region.

        Issue Links


          Jean-Daniel Cryans made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Duplicate [ 3 ]
          stack made changes -
          Fix Version/s 0.95.0 [ 12324094 ]
          Component/s Usability [ 12320397 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.94.0 [ 12316419 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.94.0 [ 12316419 ]
          stack made changes -
          Fix Version/s 0.95.0 [ 12324094 ]
          Fix Version/s 0.96.0 [ 12320040 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.96.0 [ 12320040 ]
          Fix Version/s 0.94.0 [ 12316419 ]
          Todd Lipcon made changes -
          Field Original Value New Value
          Link This issue relates to HBASE-4365 [ HBASE-4365 ]
          Jean-Daniel Cryans created issue -


            • Assignee:
              Jean-Daniel Cryans
            • Votes:
              1 Vote for this issue
              5 Start watching this issue


              • Created: