Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
0.11.1
-
None
-
None
-
Reviewed
-
With this patch, the bundled Hadoop bump up to 1.0.4.
Description
LazyOutputFormat (HADOOP-4927) in hadoop is a wrapper to avoid creating part files if there is no records output. It would be good to add support for that by having a configuration in pig which wraps storeFunc.getOutputFormat() with LazyOutputFormat.
Attachments
Attachments
Issue Links
- is related to
-
MAPREDUCE-5839 Provide a boolean switch to enable LazyOutputFormat
- Open