Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1425

archive throws OutOfMemoryError

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • harchive
    • None
    • Reviewed

    Description

      -bash-3.1$ hadoop  archive -archiveName t4.har -p . t4 .
      Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
              at java.util.regex.Pattern.compile(Pattern.java:1432)
              at java.util.regex.Pattern.<init>(Pattern.java:1133)
              at java.util.regex.Pattern.compile(Pattern.java:847)
              at java.lang.String.replace(String.java:2208)
              at org.apache.hadoop.fs.Path.normalizePath(Path.java:146)
              at org.apache.hadoop.fs.Path.initialize(Path.java:137)
              at org.apache.hadoop.fs.Path.<init>(Path.java:126)
              at org.apache.hadoop.fs.Path.makeQualified(Path.java:296)
              at org.apache.hadoop.hdfs.DistributedFileSystem.makeQualified(DistributedFileSystem.java:244)
              at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:256)
              at org.apache.hadoop.tools.HadoopArchives.archive(HadoopArchives.java:393)
              at org.apache.hadoop.tools.HadoopArchives.run(HadoopArchives.java:736)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
              at org.apache.hadoop.tools.HadoopArchives.main(HadoopArchives.java:751)
      

      Attachments

        1. har.sh
          2 kB
          Tsz-wo Sze
        2. m1425_20100129TextFileGenerator.patch
          10 kB
          Tsz-wo Sze
        3. MAPREDUCE-1425_y_0.20.patch
          4 kB
          Mahadev Konar
        4. MAPREDUCE-1425.patch
          4 kB
          Mahadev Konar
        5. MAPREDUCE-1425.patch
          5 kB
          Mahadev Konar
        6. MAPREDUCE-1425.patch
          2 kB
          Mahadev Konar

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            mahadev Mahadev Konar
            szetszwo Tsz-wo Sze
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment