Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2071

StreamXmlRecordReader throws java.io.IOException: Mark/reset exception in hadoop 0.14

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.14.3
    • 0.16.0
    • None
    • None

    Description

      In hadoop 0.14, using -inputreader StreamXmlRecordReader for streaming jobs throw
      java.io.IOException: Mark/reset exception in hadoop 0.14
      This looks to be related to (https://issues.apache.org/jira/browse/HADOOP-2067).

      <stack trace>
      Caused by: java.io.IOException: Mark/reset not supported
      at
      org.apache.hadoop.dfs.DFSClient$DFSInputStream.reset(DFSClient.java:1353)
      at java.io.FilterInputStream.reset(FilterInputStream.java:200)
      at
      org.apache.hadoop.streaming.StreamXmlRecordReader.fastReadUntilMatch(StreamX
      mlRecordReader.java:289)
      at
      org.apache.hadoop.streaming.StreamXmlRecordReader.readUntilMatchBegin(Stream
      XmlRecordReader.java:118)
      at
      org.apache.hadoop.streaming.StreamXmlRecordReader.seekNextRecordBoundary(Str
      eamXmlRecordReader.java:111)
      at
      org.apache.hadoop.streaming.StreamXmlRecordReader.init(StreamXmlRecordReader
      .java:73)
      at
      org.apache.hadoop.streaming.StreamXmlRecordReader.(StreamXmlRecordReader.jav
      a:63)

      </stack trace>

      Attachments

        1. HADOOP-2071-1.patch
          2 kB
          Lohit Vijaya Renu
        2. HADOOP-2071-2.patch
          8 kB
          Lohit Vijaya Renu
        3. HADOOP-2071-3.patch
          9 kB
          Lohit Vijaya Renu
        4. HADOOP-2071-4.patch
          11 kB
          Lohit Vijaya Renu
        5. HADOOP-2071-5.patch
          11 kB
          Lohit Vijaya Renu

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            lohit Lohit Vijaya Renu
            lohit Lohit Vijaya Renu
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment