[HDFS-16911] Distcp with snapshot diff to support Ozone filesystem. - ASF JIRA

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 3.4.0
Component/s: distcp
Labels:
- pull-request-available

Description

Currently in DistcpSync i.e the step which applies the diff b/w 2 provided snapshots as arguments to the distcp job with -diff option, only DistributedFilesystem and WebHDFS filesytems are supported.

// currently we require both the source and the target file system are
// DistributedFileSystem or (S)WebHdfsFileSystem.
if (!(srcFs instanceof DistributedFileSystem
        || srcFs instanceof WebHdfsFileSystem)) {
  throw new IllegalArgumentException("Unsupported source file system: "
      + srcFs.getScheme() + "://. " +
      "Supported file systems: hdfs://, webhdfs:// and swebhdfs://.");
}
if (!(tgtFs instanceof DistributedFileSystem
    || tgtFs instanceof WebHdfsFileSystem)) {
  throw new IllegalArgumentException("Unsupported target file system: "
      + tgtFs.getScheme() + "://. " +
      "Supported file systems: hdfs://, webhdfs:// and swebhdfs://.");
}