Details
-
Improvement
-
Status: Patch Available
-
Minor
-
Resolution: Unresolved
-
0.10.0
Description
If user sets the "mapred.output.committer.class" property in jobConf via the storage handler implementation , then he/she can override the nulloutputcommitter to get hooks for commitJob , cleanupJob etc.
Hence we can make use of the outputcommitter class in hive :
http://hadoop.apache.org/docs/r2.2.0/api/org/apache/hadoop/mapred/OutputCommitter.html
commitJob provides a place to do job context tasks if needed by the storage handler