[PIG-4442] Eliminate redundant RPC call to get file information in HPath.

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.13.0
• Fix Version/s: 0.15.0
• Hadoop Flags: Reviewed
• Assignee: Chris Nauroth
• Reporter: Chris Nauroth
• Created: 03/Mar/15 01:18
• Updated: 20/Aug/16 11:41
• Resolved: 03/Mar/15 01:22

Description

The HPath class makes 2 separate calls to FileSystem#getFileStatus to get the block size and replication. In the case of HDFS, this results in 2 separate but identical RPC transactions with the NameNode. The situation is the same for many other alternative FileSystem implementations too. We can get a minor latency improvement and lighten some RPC load on the remote services by using a single call and getting the block size and replication from the same response.

Issue Links

• is depended upon by: HADOOP-13525 Optimize uses of FS operations in the ASF analysis frameworks and libraries
• is related to: HADOOP-13321 Deprecate FileSystem APIs that promote inefficient call patterns.