Details

    • Type: Bug Bug
    • Status: Patch Available
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 1.0.4
    • Fix Version/s: 1.0.4
    • Component/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      There is rare happenings during map or reduce phase, but mostly in map phase, the Exception messages:
      java.lang.Throwable: Child Error
      at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
      Caused by: java.io.IOException: Task process exit with nonzero status of 126.
      at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)

      and error logs are cleaned, so It's very hard to debug.

      but I compared DefaultTaskController.java with 0.22, they use "bash command" to start the job scritp, but 1.0.4 use "bash, "-c", command".

      I removed "-c", everything is ok, 126 error code never happen again.

      I read man document of bash, it indicates when fork a new thread with write command, another thread with "bash -c" also has a writable fd. so I think it could return 126 status occasionally.

      So, there is only one line fix for this issue.

        Issue Links

          Activity

          Hide
          Fengdong Yu added a comment -

          But, can you tell me how will i build this code.

          under your $HADOOP_HOME/:

          mvn -Dmaven.test.skip.exec=true package

          Show
          Fengdong Yu added a comment - But, can you tell me how will i build this code. under your $HADOOP_HOME/: mvn -Dmaven.test.skip.exec=true package
          Hide
          Sigehere Smith added a comment -

          Hello Friends,
          I have done this changes in src/mapred/org/apache/hadoop/mapred/DefaultTaskController.java.
          But, can you tell me how will i build this code.

          Show
          Sigehere Smith added a comment - Hello Friends, I have done this changes in src/mapred/org/apache/hadoop/mapred/DefaultTaskController.java. But, can you tell me how will i build this code.
          Hide
          Fengdong Yu added a comment -

          Hi Harsh,

          yes, but 2374 is merged into 0.23, 2.0 and 1.1, I want this patch go into 1.0.x

          Show
          Fengdong Yu added a comment - Hi Harsh, yes, but 2374 is merged into 0.23, 2.0 and 1.1, I want this patch go into 1.0.x
          Hide
          Harsh J added a comment -

          Hi,

          I think MAPREDUCE-2374 has already addressed this. Can you take a look?

          Show
          Harsh J added a comment - Hi, I think MAPREDUCE-2374 has already addressed this. Can you take a look?
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12559815/MAPREDUCE-4857.patch
          against trunk revision .

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3107//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12559815/MAPREDUCE-4857.patch against trunk revision . -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3107//console This message is automatically generated.

            People

            • Assignee:
              Unassigned
              Reporter:
              Fengdong Yu
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:

                Development