[AMBARI-8484] [GlusterFS/HCFS] tez-site.xml and webhcat-site.xml should use default filesystem references, not explicit "hdfs:" URIs

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.6.1, 1.7.0
• Fix Version/s: 2.0.0
• Assignee: Unassigned
• Reporter: Matthew Foley
• Created: 29/Nov/14 21:02
• Updated: 18/Mar/15 01:37
• Resolved: 18/Mar/15 01:37

Description

In both branch-1.6.1 and branch-1.7.0, under ambari/ambari-server/src/main/resources/stacks/HDP/2.1/services/TEZ/configuration/, the file tez-site.xml specifies the value of tez.lib.uris as:

• <value>hdfs:///apps/tez/,hdfs:///apps/tez/lib/</value>

This explicitly references the HDFS file system, which means it won't work with any other file system. It should instead read

• <value>/apps/tez/,/apps/tez/lib/</value>
  which implicitly references the default file system specified by fs.defaultFS.

The "hdfs:///" usage causes the only apparent difference between 2.1/services/TEZ/ and 2.1.GlusterFS/services/TEZ/. The complexity of interfacing GlusterFS and other HCFS would be decreased if the explicit usage of "hdfs:///" URIs was removed.

In branch-1.6.1, a similar usage occurs in three places in webhcat-site.xml under ambari/ambari-server/src/main/resources/stacks/HDP/2.1/services/WEBHCAT/configuration/. The services/WEBHCAT subdirectory seems to be absent in branch-1.7.0, but it isn't clear why; see AMBARI-8483. If the absence is correct, then this is no longer an issue for webhcat-site.xml. If the absence is itself an error, then usage of "hdfs:///" should also be corrected for webhcat-site.xml.