Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Won't Fix
-
None
-
None
-
None
-
None
Description
MapRedTask set jobs OutputCommitter to NullOutputCommitter.
org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.prepareJobOutput(JobConf) this sets the OutputCommitter to NullOutputCommitter always.
conf.setOutputCommitter(NullOutputCommitter.class);
There are some cases where we need to customize the OutputCommitter.
Like on SUCCESS, they need to write some file or do some custom operation in theie own OutputCommitter
If someone wants to provide their own OutputCommitter then its not possible in the current implementation.
Related issues: MR - MAPREDUCE-1802, Hive - HIVE-1355.