Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
-
Reviewed
Description
distcp provides no user-configurable setting to affect the number of maps run during a copy. For large clusters, the current calculation- min(#bytes / 256MB, #nodes * 20)- can be overly aggressive.