[HBASE-7290] Online snapshots

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.95.0
• Hadoop Flags: Reviewed
• Tags: 0.96notable
• Assignee: Jonathan Hsieh
• Reporter: Jonathan Hsieh
• Created: 06/Dec/12 08:31
• Updated: 15/Oct/13 04:46
• Resolved: 21/Feb/13 04:37

Description

HBASE-6055 will be closed when the offline snapshots pieces get merged with trunk. This umbrella issue has all the online snapshot specific patches. This will get merged once one of the implementations makes it into trunk. Other flavors of online snapshots can then be done as normal patches instead of on a development branch. (was: HBASE-6055 will be closed when the online snapshots pieces get merged with trunk. This umbrella issue has all the online snapshot specific patches. This will get merged once one of the implementations makes it into trunk. Other flavors of online snapshots can then be done as normal patches instead of on a development branch.)

(not a fan of the quick edit descirption jira feature)

Issue Links

• depends upon: HBASE-6055 Offline Snapshots in HBase 0.96
• is depended upon by: HBASE-6866 Timestamp consistent snapshots
• is depended upon by: HBASE-6867 Globally consistent snapshots
• is related to: HBASE-7848 Use ZK-based read/write lock to make flush-type snapshot robust against table enable/disable/alter

Sub-Tasks

• Online snapshots scaffolding: Closed
• Globally Barriered Procedure mechanism: Closed
• Simple Log Roll Snapshot: Closed
• Simple Flush Snapshot: Closed
• subprocedure initialization fails with invalid znode data.: Closed
• Display procedure / snapshot execution state in master webui: Closed
• subprocedure zk info should be dumpable from the shell: Closed
• prove or disprove memory leak with procedure error listeners.: Closed
• [snapshots] Add documentation about online snapshots: Closed
• Cleanup stoppable/abortable/closeable in the online snapshot cases.: Closed
• Revisit naming of error handling and procedure api.: Closed
• add new online-snapshot properties to hbase-default.xml: Closed
• Refactor snapshotting tests so that all they all are exercised the same way.: Closed
• TestZKProcedure fails interrmittently.: Closed
• Snapshot attempt with the name of a previously taken snapshots fails sometimes.: Closed
• Add test that confirms that multiple concurrent snapshot requests are rejected.: Closed
• Improve snapshot related error and exception messages: Closed
• TestSnapshotDescriptionUtils#testValidateGlobalSnapshotDescriptor fails: Closed
• Fix javadoc warnings in snapshot classes: Closed
• Add additional Snapshots Unit Test Coverage: Closed
• Add metrics for snapshots: Closed
• NPE in ZKProcedureCoordinator$1.nodeCreated: Closed
• RegionServerSnapshotManager fails with CancellationException if previous snapshot fails in per region task: Closed
• More logging improvements in online snapshots code.: Closed
• Eventually all online snapshots failing due to Timeout at same regionserver.: Closed
• Fix flaky TestZKProcedure.testMultiCohortWithMemberTimeoutDuringPrepare: Closed
• improve logging messages of failed snapshot attempts.: Closed
• Prevent regions from moving during online snapshot.: Closed
• [snapshot 130201 merge] Fix TestSnapshotFromMaster failure: Closed
• [snapshot 130201 merge] Fix TestHFileArchving#testArchiveOnTableDelete: Closed
• [snapshot 130201 merge] Fix TestStoreFile failure: Closed
• [snapshot 130201 merge] Fix unresolved merge conflicts: Closed
• [snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure: Closed
• [snapshot 130201 merge] Tests with sleep after minicluster shutdown fail due to interrupt flag.: Closed
• [snapshot 130201 merge] Fix TestMultiParallel: Closed
• [snapshot 130201 merge] Remove accidentally committed hbase-server/bin files: Closed
• [snapshot 130201 merge] Fix flakey TestRestore*SnapshotFromClient#testCloneSnapshot: Closed
• [snapshot 130201 merge] Fix TestSnapshotFromClient and TestFlushSnapshotFromClient: Closed
• Parallelize offline snapshot in DisabledTableSnapshotHandler: Closed
• Use zookeeper multi to clear znodes: Closed
• Provide snapshot renaming capability: Closed
• cleanup before merging snapshots branch to trunk: Closed
• Support concurrent snapshots (on different tables): Closed
• Rename HMaster#listSnapshots as getCompletedSnapshots(): Closed
• Extract common logic between TakeSnapshotHandler and RestoreSnapshotHandler: Closed
• Add FSUtils method delete(Path f, boolean recursive): Closed
• Fix javadoc warnings in snapshot classes, part 2: Closed
• Simplify logic of SnapshotManager#getCompletedSnapshots(): Closed