Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9731

WebHCat MapReduce Streaming Job does not allow StreamXmlRecordReader to be specified

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.2.0
    • Component/s: WebHCat
    • Labels:

      Description

      Hadoop Streaming allows -inputreader parameter to specify use of StreamXmlRecorderReader
      (example)
      hadoop jar hadoop-streaming-2.5.1.jar \
      -inputreader "StreamXmlRecord,begin=BEGIN_STRING,end=END_STRING" \
      (rest of the command)
      WebHCat's StreamingDelegator does not include -inputreader as a valid option when submitting jobs to http://www.myserver.com/templeton/v1/mapreduce/streaming endpoint. If -inputreader is specified and passed to templeton server (perhaps via CURL operation) , it will get truncated and not passed as parameter from TempletonControllerJob to Hadoop.

        Attachments

        1. HIVE-9731.3.patch
          7 kB
          Hari Sankar Sivarama Subramaniyan
        2. HIVE-9731.2.patch
          7 kB
          Hari Sankar Sivarama Subramaniyan
        3. HIVE-9731.1.patch
          4 kB
          Hari Sankar Sivarama Subramaniyan

          Activity

            People

            • Assignee:
              hsubramaniyan Hari Sankar Sivarama Subramaniyan
              Reporter:
              hsubramaniyan Hari Sankar Sivarama Subramaniyan
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: