[HIVE-8307] null character in columns.comments schema property breaks jobconf.xml

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.13.0, 0.13.1, 0.14.0
• Component/s: Metastore
• Assignee: Jesús Camacho Rodríguez
• Reporter: Carl Laird
• Created: 30/Sep/14 15:21
• Updated: 27/Feb/24 22:23

Description

It would appear that the fix for https://issues.apache.org/jira/browse/HIVE-6681 is causing the null character to show up in job config xml files:

I get the following when trying to insert into an elasticsearch backed table:

[Fatal Error] :336:51: Character reference "&#
14/06/17 14:40:11 FATAL conf.Configuration: error parsing conf file: org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; Character reference "&#
Exception in thread "main" java.lang.RuntimeException: org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; Character reference "&#
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1263)
at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1129)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:1063)
at org.apache.hadoop.conf.Configuration.get(Configuration.java:416)
at org.apache.hadoop.conf.Configuration.getBoolean(Configuration.java:604)
at org.apache.hadoop.hive.conf.HiveConf.getBoolVar(HiveConf.java:1273)
at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:667)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; Character reference "&#
at com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:251)
at com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:300)
at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:121)
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1181)
... 11 more
Execution failed with exit status: 1

Line 336 of jobconf.xml:
<property><name>columns.comments</name><value>������������</value></property>

See https://groups.google.com/forum/#!msg/mongodb-user/lKbha0SzMP8/jvE8ZrJom4AJ for more discussion.

Issue Links

• links to: RB request