Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-635

IllegalArgumentException is thrown if mapred local dir is not writable.

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: examples
    • Labels:
    • Tags:
      ygridqa

      Description

      If specified mapred local directory doesn't have write permission or is non-existent then "IllegalArgumentException" is thrown. Following error message was displayed while running a sleep job with non-writable mapred local directory specified in mapred-site.xml.

      sleep job command : $hadoop_home/bin/hadoop jar hadoop-examples.jar sleep -m 100 -r 10

      2009-05-12 05:36:46,491 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_200905120525_0001_m_000000_0: java.lang.IllegalArgumentException: n must be positive
      at java.util.Random.nextInt(Random.java:250)
      at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.confChanged(LocalDirAllocator.java:243)
      at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:289)
      at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:124)
      at org.apache.hadoop.mapred.MapOutputFile.getSpillFileForWrite(MapOutputFile.java:107)
      at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1115)
      at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1028)
      at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:357)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
      at org.apache.hadoop.mapred.Child.main(Child.java:170)

      This error message(i.e. IllegalArgumentException) ,somehow, doesn't clearly indicate that problem is with mapred local directory. Error message should be more specific in this case.

        Issue Links

          Activity

          Suman Sehgal created issue -
          Nigel Daley made changes -
          Field Original Value New Value
          Tags ygridqa
          Owen O'Malley made changes -
          Project Hadoop Common [ 12310240 ] Hadoop Map/Reduce [ 12310941 ]
          Key HADOOP-5812 MAPREDUCE-635
          Affects Version/s 0.20.0 [ 12313438 ]
          Component/s examples [ 12312911 ]
          Component/s examples [ 12311574 ]
          Tags ygridqa
          Suman Sehgal made changes -
          Tags ygridqa
          Dave Latham made changes -
          Link This issue is duplicated by HADOOP-6766 [ HADOOP-6766 ]
          Allen Wittenauer made changes -
          Labels newbie

            People

            • Assignee:
              Unassigned
              Reporter:
              Suman Sehgal
            • Votes:
              1 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:

                Development