Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6159

No log of JobHistory found in all logs files

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Invalid
    • 2.2.0
    • None
    • jobhistoryserver, mrv2
    • None
    • Hadoop-2.2.0

    • historyserver, mrv2, jobhistory

    Description

      I intend to dig into 'mapreduce.jobhistory.intermediate-done-dir' argument, the position of which is at `JHAdminConfig:73`, to get some comprehension on history server. This argument is referenced at `JobHistoryEventHandler.moveToDoneNow()`, where history server moves job summary file
      from "$[yarn.app.mapreduce.am.staging-dir]/$[user]/.staging" to "$[mapreduce.jobhistory.intermediate-done-dir]/$[user]".

      The following code snippet in `moveToDoneNow()` will definitely write some logs out to log file, but I can found no any sign of it in all logs in $HADOOP_LOG_DIR via command `grep "Copied to done location" *`.
      if (copied)
      LOG.info("Copied to done location: " + toPath);
      else
      LOG.info("copy failed");

      Is there anything that I missed?

      Attachments

        Activity

          People

            Unassigned Unassigned
            jason4zhu JasonZhu
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: