Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1545

Maps hang when using native compression library to compress map out

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Invalid
    • 0.13.0
    • 0.15.0
    • None
    • None

    Description

      This issue is related to HADOOP-1193. I ran the same job. Each map of this job spawns a process which generates output to be cosumed by the map. The new native compression librar seems to hang some of the spawned processes. Some processes print using more than 100% CPU. Non-native library does not produce this problem.

      Attachments

        Activity

          People

            acmurthy Arun Murthy
            hairong Hairong Kuang
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: