Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
3.1.0
-
None
Description
The distcp numListstatusThreads option isn't used when configuring the GlobbedCopyListing used in CopyComitter.deleteMissing()
This means that for large scans of object stores, performance is significantly worse.
Fix: pass the option down from the task conf