[MAPREDUCE-1428] Make block size and the size of archive created files configurable.

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.21.0
• Component/s: harchive
• Hadoop Flags: Reviewed
• Assignee: Mahadev Konar
• Reporter: Mahadev Konar
• Created: 28/Jan/10 23:27
• Updated: 24/Aug/10 21:20
• Resolved: 02/Apr/10 16:43

Description

Currently the block size used by archives is the default block size of the hdfs filesystem. We need to make it configurable so that the block size can be higher for the part files that archives create.
Also, we need to make the size of part files in archives configurable again to make it bigger in size and create less number of such files.

Issue Links

• is duplicated by: MAPREDUCE-1465 archive partSize should be configurable
• is duplicated by: MAPREDUCE-1509 Partition size of Hadoop Archives should be configurable