Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-794

JobTracker crashes with ArithmeticException

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.9.1
    • Fix Version/s: 0.10.0
    • Component/s: None
    • Labels:
      None

      Description

      The sort benchmark on 20 nodes failed for me with an ArithmeticException. Sort.java calculates the number of maps and reduces dynamically based on the cluster size. I'm guessing at the time it did the calculation, the jobtracker had heard from 0 task trackers (which seems odd since I wait 1 minute after starting the jobtracker before starting Sort).

      From the job output:
      Running on 0 nodes to sort from /sortBenchmark20/input into /sortBenchmark20/output with 0 reduces.

      From the JobTracker log:
      2006-12-07 07:10:06,709 ERROR org.apache.hadoop.mapred.JobTracker: Job initialization failed:
      java.lang.ArithmeticException: / by zero
      at org.apache.hadoop.mapred.InputFormatBase.getSplits(InputFormatBase.java:130)
      at org.apache.hadoop.mapred.JobInProgress.initTasks(JobInProgress.java:125)
      at org.apache.hadoop.mapred.JobTracker$JobInitThread.run(JobTracker.java:326)
      at java.lang.Thread.run(Thread.java:595)

      The jobtacker should check for illegal inputs like this and not fall over.

        Attachments

        1. div-zero.patch
          2 kB
          Owen O'Malley

          Activity

            People

            • Assignee:
              owen.omalley Owen O'Malley
              Reporter:
              nidaley Nigel Daley
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: