[#HADOOP-4843] Collect Job History log file and Job Conf file into Chukwa

Hadoop Common

Collect Job History log file and Job Conf file into Chukwa

Created: 11/Dec/08 11:22 PM Updated: 08/Jul/09 04:40 PM

Return to search

Component/s:

None

Affects Version/s:

None

Fix Version/s:

0.20.0

Time Tracking:

Not Specified

File Attachments:

	File Name	Date Attached	Attached By	Size
	HADOOP-4843.patch	2009-01-15 12:30 AM	Eric Yang	6 kB

Environment:

Redhat 5.1, Java 6

Issue Links:

Blocker

This issue is blocked by:

~~HADOOP-4818~~ Enable JobTracker Instrumentation API with user job configuration

~~CHUKWA-3~~ Create Streaming Adaptor for Chukwa to stream Job History Log from HDFS

Hadoop Flags:	Reviewed
Release Note:	Introduced Chuckwa collection of job history.
Resolution Date:	17/Jan/09 03:17 AM

Description

« Hide

Chukwa monitoring framework should collect job history log file, and job configuration files for analysis of the job performance and utilization.
The current design is to tap into Job Tracker Instrumentation API. When a job is submitted, or completed, the JobTracker Instrumentation API handles the communication with Chukwa Agent to start or shutdown job log file streaming.

All

Comments

Work Log

Change History

Subversion Commits

Sort Order:

Repository	Revision	Date	User	Message
ASF	#735218	Sat Jan 17 03:16:49 UTC 2009	cdouglas	~~HADOOP-4843~~. Collect job history and configuration in Chukwa. Contributed by Eric Yang
				Files Changed
				ADD /hadoop/core/trunk/src/contrib/chukwa/src/java/org/apache/hadoop/mapred MODIFY /hadoop/core/trunk/CHANGES.txt MODIFY /hadoop/core/trunk/src/contrib/chukwa/build.xml ADD /hadoop/core/trunk/src/contrib/chukwa/src/java/org/apache/hadoop/mapred/ChukwaJobTrackerInstrumentation.java

Repository	Revision	Date	User	Message
ASF	#735219	Sat Jan 17 03:17:02 UTC 2009	cdouglas	~~HADOOP-4843~~. Collect job history and configuration in Chukwa. Contributed by Eric Yang
				Files Changed
				MODIFY /hadoop/core/branches/branch-0.20/src/contrib/chukwa/build.xml MODIFY /hadoop/core/branches/branch-0.20/CHANGES.txt ADD /hadoop/core/branches/branch-0.20/src/contrib/chukwa/src/java/org/apache/hadoop/mapred ADD /hadoop/core/branches/branch-0.20/src/contrib/chukwa/src/java/org/apache/hadoop/mapred/ChukwaJobTrackerInstrumentation.java