[TEZ-379] OutputFormat / OutputCommitter should not be used when the specific Ouput does not need them

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.2.0
• Fix Version/s: 0.2.0
• Assignee: Siddharth Seth
• Reporter: Siddharth Seth
• Created: 20/Aug/13 05:29
• Updated: 01/Dec/13 20:20
• Resolved: 20/Aug/13 18:44

Description

Currently, we end up configuring OutputFormat / OutputCommitter even if intermediate data is being used.
This leads to useless operations, and in certain circumstances can lead to random task failure since a task can end up moving output generated by another task (See TEZ-378)

Issue Links

• incorporates: TEZ-201 Temporary file lease failures seen when running outer join example job