[HADOOP-14983] DistCp diff option support for snapshot root descendant directories

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0
• Target Version/s: 3.5.0
• Assignee: Manoj Govindassamy
• Reporter: Manoj Govindassamy
• Created: 25/Oct/17 17:48
• Updated: 04/Jan/24 11:29

Description

HDFS-12544 enables SnapshotDiff generation on any snapshot root descendant directory. Previous to this, all snapshot diff operations had to be based on snapshot root directory. DistCp already supports update diff option by which snapshot diff report between any given two snapshots can be used to identify the difference between source and target, and apply the diff to the target to make it in sync with source. But, the snapshot source and target paths need to be a snapshot root directory for the diff option to work.

DistCp -update -diff <oldSnapshot> <newSnapshot> <source-snapshot-root-dir> <target-snapshot-root-dir>

Better if DistCp can also support update diff option on any descendant directories under snapshot root, provided HDFS-12544 is enabled.

Issue Links

• depends upon: HDFS-12544 SnapshotDiff - support diff generation on any snapshot root descendant directory