[FLINK-1139] HadoopOutputFormat fails for DOP > 1

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.8.0, 0.7.1-incubating
• Component/s: API / DataSet
• Assignee: Fabian Hueske
• Reporter: Fabian Hueske
• Created: 06/Oct/14 14:22
• Updated: 16/Jun/16 17:07
• Resolved: 08/Dec/14 09:32

Description

HadoopOutputFormat fails for DOP > 1. The reason is that job finalization (removal of the temp directory) is done after the first task finishes.
All other tasks will fail in that moment, since they cannot continue to write their data to the temp directory.