Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6158

No log of JobHistory found in every logs.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.2.0
    • None
    • jobhistoryserver, mrv2
    • None
    • Hadoop-2.2.0

    • historyserver, mrv2, jobhistory

    Description

      I intend to dig into 'mapreduce.jobhistory.intermediate-done-dir' argument, the position of which is at `JHAdminConfig:73`, to get some comprehension on history server. This argument is referenced at `JobHistoryEventHandler.moveToDoneNow()`, where history server moves job summary file from "${yarn.app.mapreduce.am.staging-dir}/${user}/.staging" to "${mapreduce.jobhistory.intermediate-done-dir}/${user}".

      Since the following code snippet in `moveToDoneNow()` will definitely write some logs out to log file, but I can found no any sign of it in all logs in $HADOOP_LOG_DIR via command `grep "Copied to done location" *`.
      if (copied)
      LOG.info("Copied to done location: " + toPath);
      else
      LOG.info("copy failed");

      Is there anything that I missed?

      Attachments

        Activity

          People

            Unassigned Unassigned
            jason4zhu JasonZhu
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: