[HADOOP-2052] distcp mapper's status report misleading

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Fix Version/s: 0.15.0
• Assignee: Christopher Douglas
• Reporter: Runping Qi
• Created: 13/Oct/07 17:38
• Updated: 08/Jul/09 16:52
• Resolved: 24/Oct/07 18:17

Description

When the mappers of distcp finish, the status page in the web gui reports the data copied.
However, the reported number is far away from the real number, which is very misleading.
For example, a particular mapper task_200710131713_0001_m_000000_0 reported:

Finished. Bytes copied: 4.3g

However, it does not say which file.
I thought it was for part-00000. But the file size of part-00000
is about 9GB.

It will be much clearer if the status report say something like:

Finished copy file-xxxx: 4.3g
That way, I can easily check whether the size is correct.

Issue Links

• is part of: HADOOP-2048 DISTCP mapper should report progress more often