Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-10591

Sanity check table configuration in createTable

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.99.0, hbase-10070
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Introduces sanity checks for table configuration in create and modify table against some default values. Especially we enforce region split size >= 2MB, memstore flush size >= 1MB, and 1024 <= block size <= 16MB. If you want to bypass the sanity checks, you can set "hbase.table.sanity.checks" to false, at global configuration, or at table descriptors configuration.
      Show
      Introduces sanity checks for table configuration in create and modify table against some default values. Especially we enforce region split size >= 2MB, memstore flush size >= 1MB, and 1024 <= block size <= 16MB. If you want to bypass the sanity checks, you can set "hbase.table.sanity.checks" to false, at global configuration, or at table descriptors configuration.

      Description

      We had a cluster completely become unoperational, because a couple of table was erroneously created with MAX_FILESIZE set to 4K, which resulted in 180K regions in a short interval, and bringing the master down due to HBASE-4246.

      We can do some sanity checking in master.createTable() and reject the requests. We already check the compression there, so it seems a good place. Alter table should also check for this as well.

        Attachments

        1. hbase-10591_v1.patch
          10 kB
          Enis Soztutar
        2. hbase-10591_v2.patch
          14 kB
          Enis Soztutar
        3. hbase-10591_v3.patch
          20 kB
          Enis Soztutar
        4. hbase-10591_v4.patch
          20 kB
          Enis Soztutar
        5. hbase-10591_v5.patch
          22 kB
          Enis Soztutar

          Issue Links

            Activity

              People

              • Assignee:
                enis Enis Soztutar
                Reporter:
                enis Enis Soztutar
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: