[CRUNCH-481] Support independent output committers for multiple outputs

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.12.0
• Component/s: Core
• Assignee: Josh Wills
• Reporter: Aniket Kulkarni
• Created: 24/Nov/14 23:08
• Updated: 18/May/15 19:04
• Resolved: 13/Feb/15 14:51

Description

I faced this issue while trying to write to Kite and HDFS in the same pipeline. A similar issue was logged for Kite[1][2].
I was attempting to write a PCollection to Kite and a different PTable to HDFS as a text file. The write to Kite succeeded, however the write to HDFS only produced a _SUCCESS file with no text file.
Commenting out the write to Kite seems to solve the issue and I can see the text file being written.

[1] - https://issues.cloudera.org/browse/CDK-756
[2] - http://mail-archives.apache.org/mod_mbox/crunch-dev/201401.mbox/[e-mail]%3E