[HBASE-22977] [HBCK2] hbck2 2.0

• Type: Brainstorming
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Michael Stack
• Created: 05/Sep/19 18:39
• Updated: 03/Oct/19 17:23

Description

Brainstorming issue for what to ship in an HBCK2 version 2.0 (HBASE-21745 describes HBCK2 1.0).

Possibilities:

• Integrate HBCK2 operations into core either by automating fix or by adding shell commands for fixup.
• An 'adoption service' running in Master where you pass 'orphan data' – a file or a directory – and the running service figures what to do w/ the content (remove if empty, figure where the file should slot if an hfile, replay recovered edits if a recovered_edits dir, play WALs if wal dir, etc.). Could be smarter/interactive, a 'three-way-merge' as Sean and Josh have sketched.

Issue Links

• is related to: HBASE-21745 Make HBCK2 be able to fix issues other than region assignment

Sub-Tasks

• [HBCK2] Add RecoveredEditsPlayer: Resolved
• Add text to show how to fix the HBCK checking result: Open
• [HBCK2] Record executed command and output to log file: Open
• [HBCK2] Fixes so it can work against hbase3: Open
• HBCK improvements: Open
• WAL tools doc cleanup; talk of WAL Reader/Verifier; link WALPlayer: Resolved