[HADOOP-2048] DISTCP mapper should report progress more often - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Blocker
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.15.0
Component/s: None
Labels:
None

Description

When I ran DISTCP to copy files from one dfs to another, I noticed that some mappers got killed due to failing to report status for 606 seconds.
I noticed that the mappers try to make a progress report for every 32MB copied. A better way to ensure progress is to use a time interval since last report.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

2048-5.patch
24/Oct/07 01:51
8 kB
Christopher Douglas
2048-4.patch
23/Oct/07 20:30
6 kB
Christopher Douglas
2048-3.patch
16/Oct/07 00:54
6 kB
Christopher Douglas

Issue Links

incorporates

HADOOP-2052 distcp mapper's status report misleading

Closed

Activity

People

Assignee:: Christopher Douglas

Reporter:: Runping Qi

Votes:: 0 Vote for this issue

Watchers:: 0 Start watching this issue

Dates

Created:: 12/Oct/07 23:33

Updated:: 05/Nov/07 18:13

Resolved:: 24/Oct/07 18:16