Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9731

WebHCat MapReduce Streaming Job does not allow StreamXmlRecordReader to be specified

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.2.0
    • WebHCat

    Description

      Hadoop Streaming allows -inputreader parameter to specify use of StreamXmlRecorderReader
      (example)
      hadoop jar hadoop-streaming-2.5.1.jar \
      -inputreader "StreamXmlRecord,begin=BEGIN_STRING,end=END_STRING" \
      (rest of the command)
      WebHCat's StreamingDelegator does not include -inputreader as a valid option when submitting jobs to http://www.myserver.com/templeton/v1/mapreduce/streaming endpoint. If -inputreader is specified and passed to templeton server (perhaps via CURL operation) , it will get truncated and not passed as parameter from TempletonControllerJob to Hadoop.

      Attachments

        1. HIVE-9731.1.patch
          4 kB
          Hari Sankar Sivarama Subramaniyan
        2. HIVE-9731.2.patch
          7 kB
          Hari Sankar Sivarama Subramaniyan
        3. HIVE-9731.3.patch
          7 kB
          Hari Sankar Sivarama Subramaniyan

        Activity

          People

            hsubramaniyan Hari Sankar Sivarama Subramaniyan
            hsubramaniyan Hari Sankar Sivarama Subramaniyan
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: