[HIVE-10223] Consolidate several redundant FileSystem API calls.

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.2.0
• Assignee: Chris Nauroth
• Reporter: Chris Nauroth
• Created: 06/Apr/15 18:43
• Updated: 26/Jul/16 19:01
• Resolved: 07/Apr/15 18:05

Description

This issue proposes to consolidate several Hive calls to the Hadoop Common FileSystem API into a fewer number of calls that still accomplish the equivalent work. FileSystem API calls typically translate into RPCs to other services like the HDFS NameNode or alternative file system implementations. Consolidating RPCs will lower latency a bit for Hive code and reduce some load on these external services.

Issue Links

• breaks: HIVE-10444 HIVE-10223 breaks hadoop-1 build
• is related to: HIVE-9736 StorageBasedAuthProvider should batch namenode-calls where possible.
• is related to: HADOOP-13321 Deprecate FileSystem APIs that promote inefficient call patterns.