Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-6469

Failure on enable/disable table will cause table state in zk to be left as enabling/disabling until master is restarted

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Invalid
    • Affects Version/s: 0.94.6
    • Fix Version/s: None
    • Component/s: master
    • Labels:
      None
    • Release Note:
      Introduces new 'force' option for enabling and disabling tables. Allows an advanced user to impose a change on table status, ie, such as after running hbck.

      Description

      In Enable/DisableTableHandler code, if something goes wrong in handling, the table state in zk is left as ENABLING / DISABLING. After that we cannot force any more action from the API or CLI, and the only recovery path is restarting the master.

          if (done) {
            // Flip the table to enabled.
            this.assignmentManager.getZKTable().setEnabledTable(
              this.tableNameStr);
            LOG.info("Table '" + this.tableNameStr
            + "' was successfully enabled. Status: done=" + done);
          } else {
            LOG.warn("Table '" + this.tableNameStr
            + "' wasn't successfully enabled. Status: done=" + done);
          }
      

      Here, if done is false, the table state is not changed. There is also no way to set skipTableStateCheck from cli / api.

      We have run into this issue a couple of times before.

        Attachments

        1. HBASE-6469_retry_enable_or_disable.patch
          14 kB
          rajeshbabu
        2. HBASE-6469_4.patch
          11 kB
          rajeshbabu
        3. HBASE-6469_3.patch
          10 kB
          rajeshbabu
        4. HBASE-6469_2.patch
          10 kB
          rajeshbabu
        5. HBASE-6469.patch
          5 kB
          rajeshbabu
        6. 6469-expose-force-r3.patch
          77 kB
          Nick Dimiduk

          Issue Links

            Activity

              People

              • Assignee:
                rajesh23 rajeshbabu
                Reporter:
                enis Enis Soztutar
              • Votes:
                0 Vote for this issue
                Watchers:
                21 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: