Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-635

IllegalArgumentException is thrown if mapred local dir is not writable.


    • Type: Bug Bug
    • Status: Open
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: examples
    • Labels:
    • Tags:


      If specified mapred local directory doesn't have write permission or is non-existent then "IllegalArgumentException" is thrown. Following error message was displayed while running a sleep job with non-writable mapred local directory specified in mapred-site.xml.

      sleep job command : $hadoop_home/bin/hadoop jar hadoop-examples.jar sleep -m 100 -r 10

      2009-05-12 05:36:46,491 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_200905120525_0001_m_000000_0: java.lang.IllegalArgumentException: n must be positive
      at java.util.Random.nextInt(Random.java:250)
      at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.confChanged(LocalDirAllocator.java:243)
      at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:289)
      at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:124)
      at org.apache.hadoop.mapred.MapOutputFile.getSpillFileForWrite(MapOutputFile.java:107)
      at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1115)
      at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1028)
      at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:357)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
      at org.apache.hadoop.mapred.Child.main(Child.java:170)

      This error message(i.e. IllegalArgumentException) ,somehow, doesn't clearly indicate that problem is with mapred local directory. Error message should be more specific in this case.

        Issue Links


          Suman Sehgal created issue -
          Nigel Daley made changes -
          Field Original Value New Value
          Tags ygridqa
          Owen O'Malley made changes -
          Project Hadoop Common [ 12310240 ] Hadoop Map/Reduce [ 12310941 ]
          Key HADOOP-5812 MAPREDUCE-635
          Affects Version/s 0.20.0 [ 12313438 ]
          Component/s examples [ 12312911 ]
          Component/s examples [ 12311574 ]
          Tags ygridqa
          Suman Sehgal made changes -
          Tags ygridqa
          Dave Latham made changes -
          Link This issue is duplicated by HADOOP-6766 [ HADOOP-6766 ]
          Allen Wittenauer made changes -
          Labels newbie


            • Assignee:
              Suman Sehgal
            • Votes:
              1 Vote for this issue
              1 Start watching this issue


              • Created: