[HIVE-348] Provide type information to custom mappers and reducers.

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned Assign to me
• Reporter: Venky Iyer
• Created: 13/Mar/09 23:38
• Updated: 03/Aug/09 18:43

Description

Either by setting an environment variable with the schema, or (ideally), configurably passing JSON data to custom mappers/reducers. This would be more data to pump into the pipe on each mapper/reducer, but it would be generated on the mapper/reducer, and it may mean much less processing for the custom script (using a fast json library compared to casting each column that needs casting based on the schema).

Issue Links

• is related to: HIVE-51 Generate and accept JSON as the input-output format from mappers and reducers