[HADOOP-3350] distcp should permit users to limit the number of maps - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.18.0
Component/s: None
Labels:
None

Hadoop Flags:

Reviewed

Description

distcp provides no user-configurable setting to affect the number of maps run during a copy. For large clusters, the current calculation- min(#bytes / 256MB, #nodes * 20)- can be overly aggressive.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

3350-0.patch
06/May/08 02:59
2 kB
Christopher Douglas
3350-1.patch
09/May/08 21:21
6 kB
Christopher Douglas

Activity

People

Assignee:: Christopher Douglas

Reporter:: Christopher Douglas

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Dates

Created:: 06/May/08 02:56

Updated:: 22/Aug/08 19:50

Resolved:: 15/May/08 20:47