Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3744

Unable to retrieve application logs via "yarn logs" or "mapred job -logs"

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.23.1, 0.24.0
    • Fix Version/s: 0.23.1
    • Component/s: mrv2
    • Labels:
      None

      Description

      Trying to retrieve application logs via the "yarn logs" shell command results in an error similar to this:

      Exception in thread "main" java.io.FileNotFoundException: File /tmp/logs/application_1327694122989_0001 does not exist.
      at org.apache.hadoop.fs.Hdfs$DirListingIterator.<init>(Hdfs.java:226)
      at org.apache.hadoop.fs.Hdfs$DirListingIterator.<init>(Hdfs.java:217)
      at org.apache.hadoop.fs.Hdfs$2.<init>(Hdfs.java:192)
      at org.apache.hadoop.fs.Hdfs.listStatusIterator(Hdfs.java:192)
      at org.apache.hadoop.fs.FileContext$20.next(FileContext.java:1371)
      at org.apache.hadoop.fs.FileContext$20.next(FileContext.java:1)
      at org.apache.hadoop.fs.FileContext$FSLinkResolver.resolve(FileContext.java:2319)
      at org.apache.hadoop.fs.FileContext.listStatus(FileContext.java:1373)
      at org.apache.hadoop.yarn.logaggregation.LogDumper.dumpAllContainersLogs(LogDumper.java:191)
      at org.apache.hadoop.yarn.logaggregation.LogDumper.run(LogDumper.java:107)
      at org.apache.hadoop.yarn.logaggregation.LogDumper.main(LogDumper.java:226)

      Trying to grab the logs via the "mapred jobs -logs" command results in this error:

      2012-01-27 14:05:52,040 INFO mapred.ClientServiceDelegate (ClientServiceDelegate.java:getProxy(246)) - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
      2012-01-27 14:05:52,041 WARN mapred.ClientServiceDelegate (ClientServiceDelegate.java:checkAndGetHSProxy(257)) - Job History Server is not configured.
      Unable to get log information for job: job_1327694122989_0001

      Even though the historyserver process is running.

      1. MAPREDUCE-3744.patch
        9 kB
        Jason Lowe
      2. MAPREDUCE-3744.patch
        9 kB
        Siddharth Seth

        Activity

        Jason Lowe created issue -
        Mahadev konar made changes -
        Field Original Value New Value
        Priority Critical [ 2 ] Blocker [ 1 ]
        Jason Lowe made changes -
        Assignee Jason Lowe [ jlowe ]
        Jason Lowe made changes -
        Attachment MAPREDUCE-3744.patch [ 12512619 ]
        Jason Lowe made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Target Version/s 0.23.1, 0.24.0 [ 12318883, 12317654 ]
        Siddharth Seth made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Target Version/s 0.24.0, 0.23.1 [ 12317654, 12318883 ] 0.23.1, 0.24.0 [ 12318883, 12317654 ]
        Siddharth Seth made changes -
        Attachment MAPREDUCE-3744.patch [ 12512874 ]
        Siddharth Seth made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hadoop Flags Reviewed [ 10343 ]
        Target Version/s 0.24.0, 0.23.1 [ 12317654, 12318883 ] 0.23.1, 0.24.0 [ 12318883, 12317654 ]
        Siddharth Seth made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Target Version/s 0.24.0, 0.23.1 [ 12317654, 12318883 ] 0.23.1, 0.24.0 [ 12318883, 12317654 ]
        Fix Version/s 0.23.1 [ 12318883 ]
        Resolution Fixed [ 1 ]
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Jason Lowe
            Reporter:
            Jason Lowe
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development