[GOBBLIN-627] Allow files in task output directory to be overwritten when renaming files with record count.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.14.0
• Fix Version/s: 0.14.0
• Component/s: gobblin-core
• Assignee: Sudarshan Vasudevan
• Reporter: Sudarshan Vasudevan
• Created: 06/Nov/18 05:20
• Updated: 06/Nov/18 18:46
• Resolved: 06/Nov/18 18:46

Description

In FsDataWriter#close(), we rename files in task output directory with overwrite option enabled. This prevents failures in the close() method of the writer, in case previous attempts of the tasks already have already written files in the task output directory.