[SPARK-14369] Implement preferredLocations() for FileScanRDD

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.0.0
• Component/s: SQL
• Target Version/s: 2.0.0
• Assignee: Cheng Lian
• Reporter: Cheng Lian
• Created: 04/Apr/16 15:32
• Updated: 22/Apr/16 04:48
• Resolved: 22/Apr/16 04:48

Description

Implement FileScanRDD.preferredLocations() to add locality support for HadoopFsRelation based data sources.

We should avoid extra block location related RPC costs for S3, which doesn't provide valid locality information.

Issue Links

• links to: [Github] Pull Request #12153 (liancheng)
• links to: [Github] Pull Request #12527 (liancheng)