Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-13008

Better default for hbase.regionserver.regionSplitLimit parameter.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 1.0.0, 1.1.0, 0.98.11
    • None
    • None
    • Reviewed
    • Hide
      The configuration parameter "hbase.regionserver.regionSplitLimit", the number of regions a regionserver can open before splitting on the server is stopped to limit further region count growth, was lowered from Integer.MAX_VALUE (2147483647) to a much more reasonable 1000, and documented in hbase-defaults.xml.
      Show
      The configuration parameter "hbase.regionserver.regionSplitLimit", the number of regions a regionserver can open before splitting on the server is stopped to limit further region count growth, was lowered from Integer.MAX_VALUE (2147483647) to a much more reasonable 1000, and documented in hbase-defaults.xml.

    Description

      Currently, the default value for hbase.regionserver.regionSplitLimit is 2147483647. Couple of customers ran into trouble, as they ended up with too many regions(~7k) running on their region servers. Would it be possible for us to come up with better default or at least some new guard rail, which can be used for logging warnings when the number of regions are going overboard?

      Ref:
      [1] https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CompactSplitThread.java#L101

      Attachments

        1. HBASE-13008.patch
          2 kB
          Srikanth Srungarapu
        2. HBASE-13008_v2.patch
          3 kB
          Srikanth Srungarapu

        Activity

          People

            srikanth235 Srikanth Srungarapu
            srikanth235 Srikanth Srungarapu
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: