HBase
  1. HBase
  2. HBASE-1730

Near-instantaneous online schema and table state updates

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.92.0
    • Component/s: None
    • Labels:
      None

      Description

      We should not need to take a table offline to update HCD or HTD.

      One option for that is putting HTDs and HCDs up into ZK, with mirror on disk catalog tables to be used only for cold init scenarios, as discussed on IRC. In this scheme, regionservers hosting regions of a table would watch permanent nodes in ZK associated with that table for schema updates and take appropriate actions out of the watcher. In effect, schema updates become another item in the ToDo list.

      /hbase/tables/<table-name>/schema

      Must be associated with a write locking scheme also handled with ZK primitives to avoid situations where one concurrent update clobbers another.

      1. HBASE-1730-2.patch
        35 kB
        Nicolas Spiegelberg
      2. HBASE-1730.patch
        37 kB
        nileema shingte
      3. 1730-v3.patch
        191 kB
        stack
      4. 1730-v2.patch
        42 kB
        stack
      5. 1730.patch
        30 kB
        stack

        Issue Links

          Activity

          Andrew Purtell created issue -
          Andrew Purtell made changes -
          Field Original Value New Value
          Link This issue relates to HBASE-1728 [ HBASE-1728 ]
          stack made changes -
          Link This issue is part of HBASE-1816 [ HBASE-1816 ]
          stack made changes -
          Assignee stack [ stack ]
          stack made changes -
          Summary online schema updates online schema and tableAdd updates
          stack made changes -
          Summary online schema and tableAdd updates Near-instantaneous online schema and table state updates
          stack made changes -
          Attachment 1730.patch [ 12423736 ]
          stack made changes -
          Attachment 1730-v2.patch [ 12423785 ]
          stack made changes -
          Link This issue blocks HBASE-1636 [ HBASE-1636 ]
          stack made changes -
          Attachment 1730-v3.patch [ 12439584 ]
          stack made changes -
          Fix Version/s 0.22.0 [ 12314223 ]
          Fix Version/s 0.21.0 [ 12313607 ]
          stack made changes -
          Priority Major [ 3 ] Critical [ 2 ]
          nileema shingte made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          nileema shingte made changes -
          Attachment HBASE-1730.patch [ 12490206 ]
          Subbu M Iyer made changes -
          Link This issue is related to HBASE-4213 [ HBASE-4213 ]
          Nicolas Spiegelberg made changes -
          Assignee stack [ stack ] Nicolas Spiegelberg [ nspiegelberg ]
          Nicolas Spiegelberg made changes -
          Attachment HBASE-1730-2.patch [ 12492869 ]
          Ted Yu made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Ted Yu made changes -
          Link This issue relates to HBASE-4729 [ HBASE-4729 ]
          Nicolas Spiegelberg made changes -
          Link This issue breaks HBASE-5359 [ HBASE-5359 ]

            People

            • Assignee:
              Nicolas Spiegelberg
              Reporter:
              Andrew Purtell
            • Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development