[#HADOOP-4847] OutputCommitter is loaded in the TaskTracker in localizeConfiguration

Hadoop Common

OutputCommitter is loaded in the TaskTracker in localizeConfiguration

Created: 12/Dec/08 12:42 AM Updated: 08/Jul/09 04:53 PM

Return to search

Component/s:

None

Affects Version/s:

0.19.0

Fix Version/s:

0.19.1

Time Tracking:

Not Specified

File Attachments:

	File Name	Date Attached	Attached By	Size
	patch-4847.txt	2008-12-24 09:38 AM	Amareshwari Sriramadasu	6 kB

Hadoop Flags:	Reviewed
Resolution Date:	08/Jan/09 05:37 AM

Description

« Hide

The TaskTracker localizes the JobConf for the task. Currently, this involves creating an OutputCommitter to set the work path. Since the TaskTracker will not have the user's OutputCommitter, this will get a ClassNotFoundException, unless they use FileOutputCommitter.

There should also be a test case for this case.

All

Comments

Work Log

Change History

Subversion Commits

Sort Order:

Repository	Revision	Date	User	Message
ASF	#732609	Thu Jan 08 05:20:28 UTC 2009	ddas	~~HADOOP-4847~~. Moves the loading of OutputCommitter to the Task. Contributed by Amareshwari Sriramadasu.
				Files Changed
				ADD /hadoop/core/trunk/src/test/testjar/CustomOutputCommitter.java MODIFY /hadoop/core/trunk/src/mapred/org/apache/hadoop/mapred/Task.java MODIFY /hadoop/core/trunk/CHANGES.txt ADD /hadoop/core/trunk/src/test/org/apache/hadoop/mapred/TestCustomOutputCommitter.java

Repository	Revision	Date	User	Message
ASF	#732610	Thu Jan 08 05:25:39 UTC 2009	ddas	Merge -r 732608:732609 from trunk onto 0.19 branch. Fixes ~~HADOOP-4847~~.
				Files Changed
				ADD /hadoop/core/branches/branch-0.19/src/test/org/apache/hadoop/mapred/TestCustomOutputCommitter.java (from /hadoop/core/trunk/src/test/org/apache/hadoop/mapred/TestCustomOutputCommitter.java) ADD /hadoop/core/branches/branch-0.19/src/test/testjar/CustomOutputCommitter.java (from /hadoop/core/trunk/src/test/testjar/CustomOutputCommitter.java) MODIFY /hadoop/core/branches/branch-0.19/src/mapred/org/apache/hadoop/mapred/Task.java MODIFY /hadoop/core/branches/branch-0.19/CHANGES.txt

Repository	Revision	Date	User	Message
ASF	#732612	Thu Jan 08 05:36:44 UTC 2009	ddas	Merge -r 732608:732609 from trunk onto 0.20 branch. Fixes ~~HADOOP-4847~~.
				Files Changed
				ADD /hadoop/core/branches/branch-0.20/src/test/org/apache/hadoop/mapred/TestCustomOutputCommitter.java (from /hadoop/core/trunk/src/test/org/apache/hadoop/mapred/TestCustomOutputCommitter.java) MODIFY /hadoop/core/branches/branch-0.20/src/mapred/org/apache/hadoop/mapred/Task.java MODIFY /hadoop/core/branches/branch-0.20/CHANGES.txt ADD /hadoop/core/branches/branch-0.20/src/test/testjar/CustomOutputCommitter.java (from /hadoop/core/trunk/src/test/testjar/CustomOutputCommitter.java)

Repository	Revision	Date	User	Message
ASF	#732627	Thu Jan 08 07:29:18 UTC 2009	ddas	~~HADOOP-4992~~. Fixes a package name problem introduced by ~~HADOOP-4847~~. Contributed by Amareshwari Sriramadasu.
				Files Changed
				MODIFY /hadoop/core/branches/branch-0.19/src/test/org/apache/hadoop/mapred/TestCustomOutputCommitter.java MODIFY /hadoop/core/branches/branch-0.19/CHANGES.txt