[MAPREDUCE-3744] Unable to retrieve application logs via "yarn logs" or "mapred job -logs"

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.23.1, 2.0.0-alpha
• Fix Version/s: 0.23.1
• Component/s: mrv2
• Target Version/s: 0.23.1
• Hadoop Flags: Reviewed
• Assignee: Jason Darrell Lowe
• Reporter: Jason Darrell Lowe
• Created: 27/Jan/12 20:31
• Updated: 10/Mar/15 04:32
• Resolved: 02/Feb/12 01:45

Description

Trying to retrieve application logs via the "yarn logs" shell command results in an error similar to this:

Exception in thread "main" java.io.FileNotFoundException: File /tmp/logs/application_1327694122989_0001 does not exist.
at org.apache.hadoop.fs.Hdfs$DirListingIterator.<init>(Hdfs.java:226)
at org.apache.hadoop.fs.Hdfs$DirListingIterator.<init>(Hdfs.java:217)
at org.apache.hadoop.fs.Hdfs$2.<init>(Hdfs.java:192)
at org.apache.hadoop.fs.Hdfs.listStatusIterator(Hdfs.java:192)
at org.apache.hadoop.fs.FileContext$20.next(FileContext.java:1371)
at org.apache.hadoop.fs.FileContext$20.next(FileContext.java:1)
at org.apache.hadoop.fs.FileContext$FSLinkResolver.resolve(FileContext.java:2319)
at org.apache.hadoop.fs.FileContext.listStatus(FileContext.java:1373)
at org.apache.hadoop.yarn.logaggregation.LogDumper.dumpAllContainersLogs(LogDumper.java:191)
at org.apache.hadoop.yarn.logaggregation.LogDumper.run(LogDumper.java:107)
at org.apache.hadoop.yarn.logaggregation.LogDumper.main(LogDumper.java:226)

Trying to grab the logs via the "mapred jobs -logs" command results in this error:

2012-01-27 14:05:52,040 INFO mapred.ClientServiceDelegate (ClientServiceDelegate.java:getProxy(246)) - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
2012-01-27 14:05:52,041 WARN mapred.ClientServiceDelegate (ClientServiceDelegate.java:checkAndGetHSProxy(257)) - Job History Server is not configured.
Unable to get log information for job: job_1327694122989_0001

Even though the historyserver process is running.