[MAPREDUCE-5315] DistCp reports success even on failure.

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.23.1, 2.0.0-alpha
• Fix Version/s: 2.1.0-beta, 0.23.9
• Component/s: distcp
• Target Version/s: 2.1.0-beta, 0.23.9
• Hadoop Flags: Reviewed
• Assignee: Mithun Radhakrishnan
• Reporter: Mithun Radhakrishnan
• Created: 10/Jun/13 21:19
• Updated: 27/Aug/13 22:22
• Resolved: 11/Jun/13 19:36

Description

DistCp doesn't check the job-status when run in blocking-mode, before returning its exit-code. (The Yahoo-internal version did this correctly.)

In blocking-mode, DistCp must check that the launched job runs to completion, and return an appropriate exit-code.

Pretty serious bug, since it affects data integrity, in Oozie-launched-DistCp actions.

(I could've sworn I had another JIRA with this patch attached.)