[HIVE-3234] getting the reporter in the recordwriter

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9.1
• Fix Version/s: 0.10.0
• Component/s: Serializers/Deserializers
• Labels: newbie

Environment

any

• Release Note: The hive code change should take care of existing code base, so it is backward compatible.
• Tags: extend RecordWriter RecordReader to pass in counter
• Assignee: Owen O'Malley
• Reporter: Jimmy Hu
• Created: 05/Jul/12 21:03
• Updated: 10/Jan/13 19:53
• Resolved: 27/Nov/12 17:13

Description

We would like to generate some custom statistics and report back to map/reduce later wen implement the
FileSinkOperator.RecordWriter interface. However, the current interface design doesn't allow us to get the map reduce reporter object. Please extend the current FileSinkOperator.RecordWriter interface so that it's close() method passes in a map reduce reporter object.

For the same reason, please also extend the RecordReader interface too to include a reporter object so that users can passes in custom map reduce counters.