[MAPREDUCE-6053] New hadoop API don't allow dynamic key-based names for output files

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: job submission
• Assignee: Unassigned
• Reporter: Paul Vasilev
• Created: 26/Aug/14 11:21
• Updated: 26/Aug/14 11:40

Description

MultipleTextOutputFormat class removed from new api. MultipleOutputs class forces developer to set names of output files at job configuration time.
So with new api I can't create files with names based on keys (I don't know all keys. Therefore I can't set output file names at job configuration time).
This is major disadvantage in comparison with old api and force developer to use it.

http://grepalex.com/2013/07/16/multipleoutputs-part2/