Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
0.9.2
-
None
-
None
Description
The InputFormat interface has a method:
FileSplit[] getSplits();
This should change to:
Split[] getSplits();
The Split interface would look like:
public interface Split extends Writable {
/** Returns a list of hosts that contain this split.
This is only used to optimize task placement, so this may be empty. */
String[] getLocations(FileSystem fs);
/** The relative, estimated cost of operating on this. Typically the size of the data in the split.
Used to prioritize tasks in a job (high-cost tasks are run first). */
long getCost();
}