Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-252

Create an InputFormat for reading lines of text as Java Strings

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • None
    • None
    • None
    • None

    Description

      Such a StringInputFormat would be like TextInputFormat but with input types of Long and String, rather than LongWritable and Text. This would allow users to write MapReduce programs that used only Java native types (i.e. no Writables).

      This is currently not possible to write without changes to Hadoop due to a limitation in the RecordReader interface explained here: https://issues.apache.org/jira/browse/HADOOP-3413?focusedCommentId=12597935#action_12597935

      Attachments

        1. hadoop-3566.patch
          19 kB
          Thomas White
        2. hadoop-3566-v2.patch
          14 kB
          Thomas White
        3. hadoop-3566-v3.patch
          14 kB
          Thomas White
        4. hadoop-3566-v4.patch
          12 kB
          Thomas White

        Issue Links

          Activity

            People

              tomwhite Thomas White
              tomwhite Thomas White
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: