Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4843

Collect Job History log file and Job Conf file into Chukwa

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.20.0
    • None
    • None

    • Redhat 5.1, Java 6

    • Reviewed
    • Introduced Chuckwa collection of job history.

    Description

      Chukwa monitoring framework should collect job history log file, and job configuration files for analysis of the job performance and utilization.
      The current design is to tap into Job Tracker Instrumentation API. When a job is submitted, or completed, the JobTracker Instrumentation API handles the communication with Chukwa Agent to start or shutdown job log file streaming.

      Attachments

        1. HADOOP-4843.patch
          6 kB
          Eric Yang

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. CHUKWA-3 Create Streaming Adaptor for Chukwa to stream Job History Log from HDFS

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-4818 Enable JobTracker Instrumentation API with user job configuration

          • Major - Major loss of function.
          • Closed

          Activity

            People

              eyang Eric Yang
              eyang Eric Yang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: