[HIVE-5634] use ReduceSinkOperator when outputting for client-side reducer

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Sergey Shelukhin
• Created: 23/Oct/13 23:24
• Updated: 23/Oct/13 23:25

Description

See HIVE-4002.
We can replace OutputCollector in ReduceSink to output to say a sequence file. Then instead of fetching file output written by file sinks in map tasks, the client-side reducer can fetch reducer output via some simple operator and work the same way as normal reducer.
It can also take advantage of additional ReduceSink functionality.