[#HADOOP-1251] A method to get the InputSplit from a Mapper

Hadoop Common

A method to get the InputSplit from a Mapper

Created: 12/Apr/07 05:54 AM Updated: 08/Jul/09 04:52 PM

Return to search

Component/s:

None

Affects Version/s:

0.12.3

Fix Version/s:

0.13.0

Time Tracking:

Not Specified

File Attachments:

File Name	Date Attached	Attached By	Size
get-input-split.patch	2007-04-16 10:32 PM	Owen O'Malley	7 kB
get-input-split.patch	2007-04-12 07:24 AM	Owen O'Malley	3 kB

Issue Links:

Dependants

This issue blocks:

~~HADOOP-234~~ Hadoop Pipes for writing map/reduce jobs in C++ and python

Resolution Date:

16/Apr/07 10:57 PM

Description

« Hide

I need a way to get the InputSplit from a Mapper. This is effectively a stop gap until we get context objects and can fix this much better. smile I introduce a static method in the TaskTracker named getInputSplit() that returns the InputSplit.

All

Comments

Work Log

Change History

Subversion Commits

Sort Order:

[ Permlink | « Hide ]

Hadoop QA added a comment - 12/Apr/07 07:47 AM

http://issues.apache.org/jira/secure/attachment/12355402/get-input-split.patch applied and successfully tested against trunk revision r527711.

Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/36/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/36/console

[ Permlink | « Hide ]

Doug Cutting added a comment - 16/Apr/07 07:49 PM

This method is not specific to TaskTracker, i.e., it should work fine with LocalRunner too, right? So there ought to be a better place to put it. JobConf? JobClient?

[ Permlink | « Hide ]

Owen O'Malley added a comment - 16/Apr/07 10:32 PM

This patch moves the getInputSplit from a static method on the TaskTracker to a non-static method on the Reporter. My intention is that getInputSplit will eventually move to the context method along with the rest of the Reporter methods.

This patch also removes the Reporter subclass in the record io testing that was reimplementing Reporter.NULL.

[ Permlink | « Hide ]

Owen O'Malley added a comment - 16/Apr/07 10:33 PM

Resubmit patch for automatic qa testing.

[ Permlink | « Hide ]

Hadoop QA added a comment - 16/Apr/07 10:54 PM

http://issues.apache.org/jira/secure/attachment/12355652/get-input-split.patch applied and successfully tested against trunk revision r529410.

Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/54/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/54/console

[ Permlink | « Hide ]

Doug Cutting added a comment - 16/Apr/07 10:57 PM

I just committed this. Thanks, Owen!

[ Permlink | « Hide ]

Hadoop QA added a comment - 17/Apr/07 11:21 AM

Integrated in Hadoop-Nightly #60 (See http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/60/)