[HBASE-12439] Procedure V2

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Affects Version/s: 2.0.0
• Component/s: master
• Labels: reliability
• Assignee: Unassigned
• Reporter: Matteo Bertozzi
• Created: 06/Nov/14 21:47
• Updated: 17/Jun/22 17:57
• Resolved: 11/Jun/22 18:10

Description

Procedure v2 (aka Notification Bus) aims to provide a unified way to build:

• multi-steps procedure with a rollback/rollforward ability in case of failure (e.g. create/delete table)
  • HBASE-12070
• notifications across multiple machines (e.g. ACLs/Labels/Quotas cache updates)
  • Make sure that every machine has the grant/revoke/label
  • Enforce "space limit" quota across the namespace
  • HBASE-10295 eliminate permanent replication zk node
• procedures across multiple machines (e.g. Snapshots)
• coordinated long-running procedures (e.g. compactions, splits, ...)
• Synchronous calls, with the ability to see the state/result in case of failure.
  • HBASE-11608 sync split

still work in progress/initial prototype: https://reviews.apache.org/r/27703/

Issue Links

• contains: HBASE-14350 Procedure V2 Phase 2: Assignment Manager
• contains: HBASE-15141 Procedure V2 - Web UI
• contains: HBASE-14336 Procedure V2 Phase 1 - Procedure Framework and Making DDL Operations fault tolerant
• contains: HBASE-14351 Procedure V2 Phase 3: Notification Bus
• contains: HBASE-14353 Procedure V2 Phase 1.1 - cleanups and master-branch-only DDL updates (incompatible with branch-1.x)
• contains: HBASE-16100 Procedure V2 - Tools
• contains: HBASE-16617 Procedure V2 - Improvements
• depends upon: HBASE-17788 Procedure V2 performance improvements
• links to: Pv2 for Devs

Sub-Tasks

• Create procedure v2 branch and add it to QA branch list: Closed