[HBASE-21351] The force update thread may have race with PE worker when the procedure is rolling back

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 3.0.0-alpha-1, 2.2.0, 2.0.3, 2.1.2
• Component/s: proc-v2
• Hadoop Flags: Reviewed
• Assignee: Duo Zhang
• Reporter: Duo Zhang
• Created: 20/Oct/18 11:58
• Updated: 23/Apr/19 11:51
• Resolved: 03/Nov/18 00:40

Description

We will acquire the procExecutionLock for a procedure when force updating its state to prevent race with PE worker, but this does not work then the procedure is rolling back.

If a procedure is failed, we will mark the root procedure stack as FAILED, and then start to rollback the whole procedure stack. We will pop every procedure in the stack and try to rollback them. So we may change the state of a procedure without holding its procExecutionLock when rolling back.

This means we may persist an intermediate state of a procedure and cause corruption when loading procedures.

Issue Links

• links to: Review Board