Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
Currently if hive.merge.[mapfiles|mapredfiles] is true and the merged output file size is determined by the input split size which is determined by mapred.min.split.size, mapred.min.split.size.per.[node|rack] and mapred.max.split.size. Sometimes it is desirable to have different output file size than the input split size.