Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4843

Collect Job History log file and Job Conf file into Chukwa

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.20.0
    • Component/s: None
    • Labels:
      None
    • Environment:

      Redhat 5.1, Java 6

    • Hadoop Flags:
      Reviewed
    • Release Note:
      Introduced Chuckwa collection of job history.

      Description

      Chukwa monitoring framework should collect job history log file, and job configuration files for analysis of the job performance and utilization.
      The current design is to tap into Job Tracker Instrumentation API. When a job is submitted, or completed, the JobTracker Instrumentation API handles the communication with Chukwa Agent to start or shutdown job log file streaming.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                eyang Eric Yang
                Reporter:
                eyang Eric Yang
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: