[HADOOP-10329] Fully qualified URIs are inconsistant and sometimes break in hadoop conf files

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.2.0
• Component/s: conf
• Labels: BB2015-05-TBR
• Assignee: Mohammad Islam
• Reporter: Travis Thompson
• Created: 06/Feb/14 21:26
• Updated: 06/May/15 03:27

Description

When specifying paths in the *-site.xml files, some are required to be fully qualified, while others (specifically hadoop.tmp.dir) break when a fully qualified uri is used.

Example:
If I set hadoop.tmp.dir in core-site to file:///something it'll create a file: directory in my $PWD.

  <property>
    <name>hadoop.tmp.dir</name>
    <value>file:///grid/a/tmp/hadoop-${user.name}</value>
  </property>

[tthompso@test ~]$ tree file\:/
file:/
└── grid
    └── a
        └── tmp
            └── hadoop-tthompso

Other places, like the datanode, or the nodemanager, will complain if I don't use fully qualified uris

  <property>
    <name>dfs.datanode.data.dir</name>
    <value>/grid/a/dfs-data/bs</value>
  </property>

WARN org.apache.hadoop.hdfs.server.common.Util: Path /grid/a/dfs-data/bs should be specified as a URI in configuration files. Please update hdfs configuration.