[CRUNCH-145] Ability to write side-outputs from pipeline

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.4.0
• Fix Version/s: 0.7.0
• Assignee: Unassigned
• Reporter: Dave Beech
• Created: 16/Jan/13 11:17
• Updated: 08/Nov/13 21:24
• Resolved: 29/Sep/13 19:12

Description

(Related to CRUNCH-144)

If a pipeline.write operation occurs in the middle of a pipeline, the planner should (where possible) perform the steps as a single mapreduce job but take advantage of side-output files.