[ORC-231] Having configurable capability to overwrite the file with the same name already exists

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4.5, 1.5.0
• Assignee: Ajay Yadav
• Reporter: piyush mukati
• Created: 17/Aug/17 05:45
• Updated: 03/Dec/19 21:11
• Resolved: 03/Dec/19 21:11

Description

Having configurable capability to overwrite the file with the same name already exists (Line no 90 in org.apache.orc.impl.PhysicalFsWriter).

Use Case:
I am using OrcOutputFormat with MultipleOutput in my MapReduce job.
Since MultipleOutput does not uses OutputCommitter so there are half/corrupt files are left from the failed reducers.
Here the files with the same name will be overwritten by the retry attempt and it will guarantee correct result from a successful job.

Issue Links

• links to: GitHub Pull Request #162