[HADOOP-18891] hadoop distcp needs support to filter by file/directory attribute

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.3.6
• Component/s: tools/distcp
• Labels: pull-request-available

Environment

hadoop3.3.6

• Assignee: Unassigned
• Reporter: Authur Wang
• Created: 13/Sep/23 06:16
• Updated: 26/Sep/23 03:33

Description

In some circumstances, we need to filter file/directory by file/directroy. For example, we need to filter out them by file modified time, isDir attrs, etc.

So, should we introduce a new method  public boolean shouldCopy(CopyListingFileStatus fileStatus) ? 
by this approach, we can introduce a more fluent way to do things than  public abstract boolean shouldCopy(Path path).

Issue Links

• links to: GitHub Pull Request #6070