-
Type:
Improvement
-
Status: Closed
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: 0.23.0
-
Fix Version/s: 0.23.10, 2.1.1-beta
-
Component/s: job submission
-
Labels:None
-
Target Version/s:
-
Hadoop Flags:Reviewed
This jira will make FileInputFormat and CombinedFileInputForm to use the new API, thus reducing the number of RPCs to HDFS NameNode.
- breaks
-
HIVE-5070 Implement listLocatedStatus() in ProxyFileSystem for 0.23 shim
-
- Resolved
-
- is blocked by
-
HDFS-202 Add a bulk FIleSystem.getFileBlockLocations
-
- Closed
-
- is related to
-
MAPREDUCE-6219 Reduce memory required for FileInputFormat located status optimization
-
- Open
-
-
MAPREDUCE-5603 Ability to disable FileInputFormat listLocatedStatus optimization to save client memory
-
- Resolved
-