[HADOOP-15384] distcp numListstatusThreads option doesn't get to -delete scan

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.1
• Component/s: tools/distcp
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 13/Apr/18 09:51
• Updated: 10/Jul/18 09:52
• Resolved: 10/Jul/18 09:51

Description

The distcp numListstatusThreads option isn't used when configuring the GlobbedCopyListing used in CopyComitter.deleteMissing()

This means that for large scans of object stores, performance is significantly worse.

Fix: pass the option down from the task conf