[HDFS-161] DataNode will create missing dfs.data.dir directories contrary to docs

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: datanode, documentation
• Labels: newbie
• Assignee: Unassigned
• Reporter: Todd Lipcon
• Created: 06/Dec/08 21:21
• Updated: 29/Apr/12 12:41

Description

The documentation (and HADOOP-340) seems to indicate that if a data dir listed in dfs.data.dir does not exist, it will be ignored. In fact, if the hadoop user has access to (essentially) mkdir -p the data dir it will do so.

I'd like to add another configuration parameter, perhaps dfs.data.dir.create with default true (to not break any existing tutorials). If this is set to false then data dirs that do not exist will not implicitly be created.

The motivation for this is the same as HADOOP-340 - we have different disk configs in our cluster and hadoop is creating data dirs where we do not want them.

Issue Links

• relates to: WHIRR-351 configure_hadoop should create+chown all data dirs listed in hadoop-hdfs.dfs.data.dir