[FLINK-1236] Add support for localization of Hadoop Input Splits

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.9
• Labels: starter
• Assignee: Fabian Hueske
• Reporter: Robert Metzger
• Created: 12/Nov/14 16:10
• Updated: 06/Jan/15 13:22
• Resolved: 06/Jan/15 13:22

Description

Flink is currently not localizing splits created by Hadoop Input formats.

The getInputSplitAssigner() of the HadoopInputFormat is returning the DefaultInputSplitAssigner instead of the LocatableInputSplitAssigner().

It should be possible to make the HadoopInputSplit a LocatableInputSplit, because Hadoop's InputSplit also contains the hostnames, for exactly this purpose.