[HIVE-9731] WebHCat MapReduce Streaming Job does not allow StreamXmlRecordReader to be specified

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.2.0
• Component/s: WebHCat
• Labels: TODOC1.2
• Assignee: Hari Sankar Sivarama Subramaniyan Assign to me
• Reporter: Hari Sankar Sivarama Subramaniyan
• Created: 19/Feb/15 22:19
• Updated: 18/May/15 19:56
• Resolved: 26/Feb/15 17:53

Description

Hadoop Streaming allows -inputreader parameter to specify use of StreamXmlRecorderReader
(example)
hadoop jar hadoop-streaming-2.5.1.jar \
-inputreader "StreamXmlRecord,begin=BEGIN_STRING,end=END_STRING" \
(rest of the command)
WebHCat's StreamingDelegator does not include -inputreader as a valid option when submitting jobs to http://www.myserver.com/templeton/v1/mapreduce/streaming endpoint. If -inputreader is specified and passed to templeton server (perhaps via CURL operation) , it will get truncated and not passed as parameter from TempletonControllerJob to Hadoop.