Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3744

Unable to retrieve application logs via "yarn logs" or "mapred job -logs"

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.23.1, 2.0.0-alpha
    • 0.23.1
    • mrv2
    • None
    • Reviewed

    Description

      Trying to retrieve application logs via the "yarn logs" shell command results in an error similar to this:

      Exception in thread "main" java.io.FileNotFoundException: File /tmp/logs/application_1327694122989_0001 does not exist.
      at org.apache.hadoop.fs.Hdfs$DirListingIterator.<init>(Hdfs.java:226)
      at org.apache.hadoop.fs.Hdfs$DirListingIterator.<init>(Hdfs.java:217)
      at org.apache.hadoop.fs.Hdfs$2.<init>(Hdfs.java:192)
      at org.apache.hadoop.fs.Hdfs.listStatusIterator(Hdfs.java:192)
      at org.apache.hadoop.fs.FileContext$20.next(FileContext.java:1371)
      at org.apache.hadoop.fs.FileContext$20.next(FileContext.java:1)
      at org.apache.hadoop.fs.FileContext$FSLinkResolver.resolve(FileContext.java:2319)
      at org.apache.hadoop.fs.FileContext.listStatus(FileContext.java:1373)
      at org.apache.hadoop.yarn.logaggregation.LogDumper.dumpAllContainersLogs(LogDumper.java:191)
      at org.apache.hadoop.yarn.logaggregation.LogDumper.run(LogDumper.java:107)
      at org.apache.hadoop.yarn.logaggregation.LogDumper.main(LogDumper.java:226)

      Trying to grab the logs via the "mapred jobs -logs" command results in this error:

      2012-01-27 14:05:52,040 INFO mapred.ClientServiceDelegate (ClientServiceDelegate.java:getProxy(246)) - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
      2012-01-27 14:05:52,041 WARN mapred.ClientServiceDelegate (ClientServiceDelegate.java:checkAndGetHSProxy(257)) - Job History Server is not configured.
      Unable to get log information for job: job_1327694122989_0001

      Even though the historyserver process is running.

      Attachments

        1. MAPREDUCE-3744.patch
          9 kB
          Siddharth Seth
        2. MAPREDUCE-3744.patch
          9 kB
          Jason Darrell Lowe

        Activity

          People

            jlowe Jason Darrell Lowe
            jlowe Jason Darrell Lowe
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: