[VFS-555] Add ability to specify alternate HDFS configuration file

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.1
• Fix Version/s: 2.1

Environment

All

• Assignee: Bernd Eckenfels
• Reporter: Roger Lee Whitcomb
• Created: 08/Jan/15 17:19
• Updated: 19/May/16 18:25
• Resolved: 03/Feb/15 00:50

Description

We need to access HDFS on an AWS installation from outside the AWS firewall. The technique is described here: http://rainerpeter.wordpress.com/2014/02/12/connect-to-hdfs-running-in-ec2-using-public-ip-addresses/
In order to do this we need to set the "dfs.client.use.datanode.hostname=true" in an alternate configuration file set after the default configuration is loaded.
I propose to add a property "configName" to HdfsFileSystemConfigBuilder, and then code in HdfsFileSystem to get the value of the property and set it in the Configuration.

Issue Links

• is related to: VFS-586 Add more ways to specify alternate HDFS configuration information