[HADOOP-7631] In mapred-site.xml, stream.tmpdir is mapped to ${mapred.temp.dir} which is undeclared.

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.20.205.0
• Fix Version/s: 0.20.205.0, 0.23.0
• Component/s: conf
• Assignee: Eric Yang
• Reporter: Ramya Sunil
• Created: 13/Sep/11 19:31
• Updated: 19/Oct/11 00:26
• Resolved: 18/Sep/11 03:56

Description

Streaming jobs seem to fail with the following exception:

Exception in thread "main" java.io.IOException: No such file or directory
        at java.io.UnixFileSystem.createFileExclusively(Native Method)
        at java.io.File.checkAndCreate(File.java:1704)
        at java.io.File.createTempFile(File.java:1792)
        at org.apache.hadoop.streaming.StreamJob.packageJobJar(StreamJob.java:603)
        at org.apache.hadoop.streaming.StreamJob.setJobConf(StreamJob.java:798)
        at org.apache.hadoop.streaming.StreamJob.run(StreamJob.java:117)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
        at org.apache.hadoop.streaming.HadoopStreaming.main(HadoopStreaming.java:32)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

Eric pointed out that in RPM based installs, in /etc/hadoop/mapred-site.xml, stream.tmpdir is mapped to ${mapred.temp.dir}, but ${mapred.temp.dir} is not declared