Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-8753

LocalDirAllocator throws "ArithmeticException: / by zero" when there is no available space on configured local dir

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 2.0.2-alpha
    • 2.3.0
    • None
    • None

    Description

      12/08/09 13:59:49 INFO mapreduce.Job: Task Id : attempt_1344492468506_0023_m_000000_0, Status : FAILED
      java.lang.ArithmeticException: / by zero
      at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:371)
      at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
      at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
      at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:115)
      at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.getLocalPathForWrite(LocalDirsHandlerService.java:257)
      at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:849)

      Instead of throwing exception directly we can log a warning saying no available space on configured local dir

      Attachments

        1. YARN-16.patch
          0.9 kB
          Benoy Antony
        2. HADOOP-8753.1.patch
          0.9 kB
          Hitesh Shah
        3. HADOOP-8753.1.copy.patch
          0.9 kB
          Hitesh Shah

        Issue Links

          Activity

            People

              benoyantony Benoy Antony
              nishan Nishan Shetty
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: