[MAPREDUCE-1425] archive throws OutOfMemoryError

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.21.0
• Component/s: harchive
• Hadoop Flags: Reviewed
• Assignee: Mahadev Konar
• Reporter: Tsz-wo Sze
• Created: 28/Jan/10 22:26
• Updated: 24/Aug/10 21:20
• Resolved: 09/Feb/10 23:40

Description

-bash-3.1$ hadoop  archive -archiveName t4.har -p . t4 .
Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
        at java.util.regex.Pattern.compile(Pattern.java:1432)
        at java.util.regex.Pattern.<init>(Pattern.java:1133)
        at java.util.regex.Pattern.compile(Pattern.java:847)
        at java.lang.String.replace(String.java:2208)
        at org.apache.hadoop.fs.Path.normalizePath(Path.java:146)
        at org.apache.hadoop.fs.Path.initialize(Path.java:137)
        at org.apache.hadoop.fs.Path.<init>(Path.java:126)
        at org.apache.hadoop.fs.Path.makeQualified(Path.java:296)
        at org.apache.hadoop.hdfs.DistributedFileSystem.makeQualified(DistributedFileSystem.java:244)
        at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:256)
        at org.apache.hadoop.tools.HadoopArchives.archive(HadoopArchives.java:393)
        at org.apache.hadoop.tools.HadoopArchives.run(HadoopArchives.java:736)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
        at org.apache.hadoop.tools.HadoopArchives.main(HadoopArchives.java:751)