[HIVE-1355] Hive should use NullOutputFormat for hadoop jobs

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.6.0
• Component/s: Query Processor
• Hadoop Flags: Reviewed
• Assignee: Joydeep Sen Sarma
• Reporter: Joydeep Sen Sarma
• Created: 20/May/10 01:05
• Updated: 23/Jul/19 11:41
• Resolved: 02/Jun/10 16:36

Description

• see https://issues.apache.org/jira/browse/MAPREDUCE-1802

hive doesn't depend on hadoop job output folder. it produces output exclusively via side effect folders. we should use an outputformat that can request hadoop skip cleanup/setup. this could be nulloutputformat (unless there are any objections in hadoop to changing nulloutputformat behavior).

as a small side effect, it also avoids some totally unnecessary hdfs file creates and deletes in hdfs.