Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-593

org.apache.hadoop.streaming.TestUlimit fails on JRockit 64-bit; not enough memory

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: contrib/streaming
    • Labels:
      None
    • Environment:

      Description

      the testUlimit test sets a memory limit that is too small for Java to start. So it fails with a -1 response instead, which breaks the test.

        Issue Links

          Activity

          Hide
          Allen Wittenauer added a comment -

          Won't Fix works for me, historical Steve.

          Show
          Allen Wittenauer added a comment - Won't Fix works for me, historical Steve.
          Hide
          steve_l added a comment -

          Since Oracle stopped making new releases of the JRockit JVM public, and the old version not up to date w/r/t security patches, I've stopped using JRockit. So I can no longer replicate this.

          That doesn't mean that the ulimit should not be overrideable, as the problem may arise again in future. Only that we won't be able to check any fix works.

          Why not downgrade to WONTFIX or WORKSFORME until someone else re-encounters the problem?

          Show
          steve_l added a comment - Since Oracle stopped making new releases of the JRockit JVM public, and the old version not up to date w/r/t security patches, I've stopped using JRockit. So I can no longer replicate this. That doesn't mean that the ulimit should not be overrideable, as the problem may arise again in future. Only that we won't be able to check any fix works. Why not downgrade to WONTFIX or WORKSFORME until someone else re-encounters the problem?
          Hide
          steve_l added a comment -

          What would seem a good solution here would be allow anyone to override the memory limit in their build.properties file; have a test.ulimit value that could be overridden.
          That avoids the test having to be clever about JVM size; make it up to the user whose tests fail.

          Show
          steve_l added a comment - What would seem a good solution here would be allow anyone to override the memory limit in their build.properties file; have a test.ulimit value that could be overridden. That avoids the test having to be clever about JVM size; make it up to the user whose tests fail.
          Hide
          steve_l added a comment -

          And what happens when you set a ulimit of that size: JRockit refuses to play

          > bash
          slo@morzine:~/Java/Apache/hadoop-core$ ulimit -v 786432
          slo@morzine:~/Java/Apache/hadoop-core$ java -version
          [ERROR] Not enough virtual memory to start JRockit.
          [INFO ] If you use 'ulimit -v <amount>', make sure you specify the amount to at least 1100000
          Could not create the Java virtual machine.

          Show
          steve_l added a comment - And what happens when you set a ulimit of that size: JRockit refuses to play > bash slo@morzine:~/Java/Apache/hadoop-core$ ulimit -v 786432 slo@morzine:~/Java/Apache/hadoop-core$ java -version [ERROR] Not enough virtual memory to start JRockit. [INFO ] If you use 'ulimit -v <amount>', make sure you specify the amount to at least 1100000 Could not create the Java virtual machine.
          Hide
          steve_l added a comment -

          stack trace in the test

          08/09/01 13:47:05 [Thread-84] INFO mapred.TaskTracker : LaunchTaskAction: attempt_200809011346_0001_m_000002_0
          08/09/01 13:47:05 [IPC Server handler 9 on 43325] INFO mapred.TaskInProgress : Error from attempt_200809011346_0001_m_000001_0: java.io.IOException: Task process exit with nonzero status of 1: bash -c "'ulimit' '-v' '786432' ;exec '/usr/java/jrockit-1.6.0_02/jre/bin/java' '-Djava.library.path=/usr/java/jrockit-1.6.0_02/jre/lib/amd64/jrockit:/usr/java/jrockit-1.6.0_02/jre/lib/amd64:/usr/java/jrockit-1.6.0_02/jre/../lib/amd64:/home/slo/Java/Apache/hadoop-core/build/contrib/streaming/test/mapred/local/1_0/taskTracker/jobcache/job_200809011346_0001/attempt_200809011346_0001_m_000001_0/work' '-Xmx200m' '-Djava.io.tmpdir=/home/slo/Java/Apache/hadoop-core/build/contrib/streaming/test/mapred/local/1_0/taskTracker/jobcache/job_200809011346_0001/attempt_200809011346_0001_m_000001_0/work/tmp' '-classpath' '/home/slo/Java/Apache/hadoop-core/build/contrib/streaming/test:/home/slo/Java/Apache/hadoop-core/build/test/classes:/home/slo/Java/Apache/hadoop-core/src/contrib/test:/home/slo/Java/Apache/hadoop-core/conf:/home/slo/Java/Apache/hadoop-core/build:/home/slo/Java/Apache/hadoop-core/build/contrib/streaming/examples:/home/slo/Java/Apache/hadoop-core/build/contrib/streaming/classes:/home/slo/Java/Apache/hadoop-core/build/classes:/home/slo/Java/Apache/hadoop-core/lib/commons-cli-2.0-SNAPSHOT.jar:/home/slo/Java/Apache/hadoop-core/lib/commons-codec-1.3.jar:/home/slo/Java/Apache/hadoop-core/lib/commons-httpclient-3.0.1.jar:/home/slo/Java/Apache/hadoop-core/lib/commons-logging-1.0.4.jar:/home/slo/Java/Apache/hadoop-core/lib/commons-logging-api-1.0.4.jar:/home/slo/Java/Apache/hadoop-core/lib/commons-net-1.4.1.jar:/home/slo/Java/Apache/hadoop-core/lib/jets3t-0.6.1.jar:/home/slo/Java/Apache/hadoop-core/lib/jetty-5.1.4.jar:/home/slo/Java/Apache/hadoop-core/lib/jetty-ext/commons-el.jar:/home/slo/Java/Apache/hadoop-core/lib/jetty-ext/jasper-compiler.jar:/home/slo/Java/Apache/hadoop-core/lib/jetty-ext/jasper-runtime.jar:/home/slo/Java/Apache/hadoop-core/lib/jetty-ext/jsp-api.jar:/home/slo/Java/Apache/hadoop-core/lib/junit-3.8.1.jar:/home/slo/Java/Apache/hadoop-core/lib/kfs-0.2.0.jar:/home/slo/Java/Apache/hadoop-core/lib/log4j-1.2.15.jar:/home/slo/Java/Apache/hadoop-core/lib/oro-2.0.8.jar:/home/slo/Java/Apache/hadoop-core/lib/servlet-api.jar:/home/slo/Java/Apache/hadoop-core/lib/slf4j-api-1.4.3.jar:/home/slo/Java/Apache/hadoop-core/lib/slf4j-log4j12-1.4.3.jar:/home/slo/Java/Apache/hadoop-core/lib/xmlenc-0.52.jar:/home/slo/Java/Apache/ant/lib/junit-3.8.2.jar:/home/slo/Java/Apache/ant/lib/ant-launcher.jar:/home/slo/Java/Apache/ant/lib/ant.jar:/home/slo/Java/Apache/ant/lib/ant-junit.jar::/home/slo/Java/Apache/hadoop-core/build/contrib/streaming/test/mapred/local/1_0/taskTracker/jobcache/job_200809011346_0001/jars/classes:/home/slo/Java/Apache/hadoop-core/build/contrib/streaming/test/mapred/local/1_0/taskTracker/jobcache/job_200809011346_0001/jars:/home/slo/Java/Apache/hadoop-core/build/contrib/streaming/test/mapred/local/1_0/taskTracker/jobcache/job_200809011346_0001/attempt_200809011346_0001_m_000001_0/work' '-Dhadoop.log.dir=/home/slo/Java/Apache/hadoop-core/build/contrib/streaming/test/logs' '-Dhadoop.root.logger=INFO,TLA' '-Dhadoop.tasklog.taskid=attempt_200809011346_0001_m_000001_0' '-Dhadoop.tasklog.totalLogFileSize=0' 'org.apache.hadoop.mapred.TaskTracker$Child' '127.0.0.1' '60775' 'attempt_200809011346_0001_m_000001_0' < /dev/null 1>> /home/slo/Java/Apache/hadoop-core/build/contrib/streaming/test/logs/userlogs/attempt_200809011346_0001_m_000001_0/stdout 2>> /home/slo/Java/Apache/hadoop-core/build/contrib/streaming/test/logs/userlogs/attempt_200809011346_0001_m_000001_0/stderr"
          at org.apache.hadoop.mapred.TaskRunner.runChild(TaskRunner.java:463)
          at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:404)

          Show
          steve_l added a comment - stack trace in the test 08/09/01 13:47:05 [Thread-84] INFO mapred.TaskTracker : LaunchTaskAction: attempt_200809011346_0001_m_000002_0 08/09/01 13:47:05 [IPC Server handler 9 on 43325] INFO mapred.TaskInProgress : Error from attempt_200809011346_0001_m_000001_0: java.io.IOException: Task process exit with nonzero status of 1: bash -c "'ulimit' '-v' '786432' ;exec '/usr/java/jrockit-1.6.0_02/jre/bin/java' '-Djava.library.path=/usr/java/jrockit-1.6.0_02/jre/lib/amd64/jrockit:/usr/java/jrockit-1.6.0_02/jre/lib/amd64:/usr/java/jrockit-1.6.0_02/jre/../lib/amd64:/home/slo/Java/Apache/hadoop-core/build/contrib/streaming/test/mapred/local/1_0/taskTracker/jobcache/job_200809011346_0001/attempt_200809011346_0001_m_000001_0/work' '-Xmx200m' '-Djava.io.tmpdir=/home/slo/Java/Apache/hadoop-core/build/contrib/streaming/test/mapred/local/1_0/taskTracker/jobcache/job_200809011346_0001/attempt_200809011346_0001_m_000001_0/work/tmp' '-classpath' '/home/slo/Java/Apache/hadoop-core/build/contrib/streaming/test:/home/slo/Java/Apache/hadoop-core/build/test/classes:/home/slo/Java/Apache/hadoop-core/src/contrib/test:/home/slo/Java/Apache/hadoop-core/conf:/home/slo/Java/Apache/hadoop-core/build:/home/slo/Java/Apache/hadoop-core/build/contrib/streaming/examples:/home/slo/Java/Apache/hadoop-core/build/contrib/streaming/classes:/home/slo/Java/Apache/hadoop-core/build/classes:/home/slo/Java/Apache/hadoop-core/lib/commons-cli-2.0-SNAPSHOT.jar:/home/slo/Java/Apache/hadoop-core/lib/commons-codec-1.3.jar:/home/slo/Java/Apache/hadoop-core/lib/commons-httpclient-3.0.1.jar:/home/slo/Java/Apache/hadoop-core/lib/commons-logging-1.0.4.jar:/home/slo/Java/Apache/hadoop-core/lib/commons-logging-api-1.0.4.jar:/home/slo/Java/Apache/hadoop-core/lib/commons-net-1.4.1.jar:/home/slo/Java/Apache/hadoop-core/lib/jets3t-0.6.1.jar:/home/slo/Java/Apache/hadoop-core/lib/jetty-5.1.4.jar:/home/slo/Java/Apache/hadoop-core/lib/jetty-ext/commons-el.jar:/home/slo/Java/Apache/hadoop-core/lib/jetty-ext/jasper-compiler.jar:/home/slo/Java/Apache/hadoop-core/lib/jetty-ext/jasper-runtime.jar:/home/slo/Java/Apache/hadoop-core/lib/jetty-ext/jsp-api.jar:/home/slo/Java/Apache/hadoop-core/lib/junit-3.8.1.jar:/home/slo/Java/Apache/hadoop-core/lib/kfs-0.2.0.jar:/home/slo/Java/Apache/hadoop-core/lib/log4j-1.2.15.jar:/home/slo/Java/Apache/hadoop-core/lib/oro-2.0.8.jar:/home/slo/Java/Apache/hadoop-core/lib/servlet-api.jar:/home/slo/Java/Apache/hadoop-core/lib/slf4j-api-1.4.3.jar:/home/slo/Java/Apache/hadoop-core/lib/slf4j-log4j12-1.4.3.jar:/home/slo/Java/Apache/hadoop-core/lib/xmlenc-0.52.jar:/home/slo/Java/Apache/ant/lib/junit-3.8.2.jar:/home/slo/Java/Apache/ant/lib/ant-launcher.jar:/home/slo/Java/Apache/ant/lib/ant.jar:/home/slo/Java/Apache/ant/lib/ant-junit.jar::/home/slo/Java/Apache/hadoop-core/build/contrib/streaming/test/mapred/local/1_0/taskTracker/jobcache/job_200809011346_0001/jars/classes:/home/slo/Java/Apache/hadoop-core/build/contrib/streaming/test/mapred/local/1_0/taskTracker/jobcache/job_200809011346_0001/jars:/home/slo/Java/Apache/hadoop-core/build/contrib/streaming/test/mapred/local/1_0/taskTracker/jobcache/job_200809011346_0001/attempt_200809011346_0001_m_000001_0/work' '-Dhadoop.log.dir=/home/slo/Java/Apache/hadoop-core/build/contrib/streaming/test/logs' '-Dhadoop.root.logger=INFO,TLA' '-Dhadoop.tasklog.taskid=attempt_200809011346_0001_m_000001_0' '-Dhadoop.tasklog.totalLogFileSize=0' 'org.apache.hadoop.mapred.TaskTracker$Child' '127.0.0.1' '60775' 'attempt_200809011346_0001_m_000001_0' < /dev/null 1>> /home/slo/Java/Apache/hadoop-core/build/contrib/streaming/test/logs/userlogs/attempt_200809011346_0001_m_000001_0/stdout 2>> /home/slo/Java/Apache/hadoop-core/build/contrib/streaming/test/logs/userlogs/attempt_200809011346_0001_m_000001_0/stderr" at org.apache.hadoop.mapred.TaskRunner.runChild(TaskRunner.java:463) at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:404)

            People

            • Assignee:
              Unassigned
              Reporter:
              Steve Loughran
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development