Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-8753

LocalDirAllocator throws "ArithmeticException: / by zero" when there is no available space on configured local dir

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.0.2-alpha
    • Fix Version/s: 2.3.0
    • Component/s: None
    • Labels:
      None

      Description

      12/08/09 13:59:49 INFO mapreduce.Job: Task Id : attempt_1344492468506_0023_m_000000_0, Status : FAILED
      java.lang.ArithmeticException: / by zero
      at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:371)
      at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
      at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
      at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:115)
      at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.getLocalPathForWrite(LocalDirsHandlerService.java:257)
      at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:849)

      Instead of throwing exception directly we can log a warning saying no available space on configured local dir

        Attachments

        1. YARN-16.patch
          0.9 kB
          Benoy Antony
        2. HADOOP-8753.1.patch
          0.9 kB
          Hitesh Shah
        3. HADOOP-8753.1.copy.patch
          0.9 kB
          Hitesh Shah

          Issue Links

            Activity

              People

              • Assignee:
                benoyantony Benoy Antony
                Reporter:
                nishan Nishan Shetty
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: