[HADOOP-12118] Validate xml configuration files with XML Schema

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Christopher Tubbs
• Created: 24/Jun/15 21:11
• Updated: 02/Sep/15 23:16

Description

I spent an embarrassingly long time today trying to figure out why the following wouldn't work.

<property>
  <key>fs.defaultFS</key>
  <value>hdfs://localhost:9000</value>
</property>

I just kept getting an error about no authority for fs.defaultFS, with a value of file:///, which made no sense... because I knew it was there.

The problem was that the core-site.xml was parsed entirely without any validation. This seems incorrect. The very least that could be done is a simple XML Schema validation against an XSD, before parsing. That way, users will get immediate failures on common typos and other problems in the xml configuration files.

Issue Links

• is related to: HADOOP-7947 Validate XMLs if a relevant tool is available, when using scripts
• relates to: HADOOP-10623 Provide a utility to be able inspect the config as seen by a hadoop client / daemon