Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-252

Create an InputFormat for reading lines of text as Java Strings

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Incomplete
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Such a StringInputFormat would be like TextInputFormat but with input types of Long and String, rather than LongWritable and Text. This would allow users to write MapReduce programs that used only Java native types (i.e. no Writables).

      This is currently not possible to write without changes to Hadoop due to a limitation in the RecordReader interface explained here: https://issues.apache.org/jira/browse/HADOOP-3413?focusedCommentId=12597935#action_12597935

      1. hadoop-3566-v4.patch
        12 kB
        Tom White
      2. hadoop-3566-v3.patch
        14 kB
        Tom White
      3. hadoop-3566-v2.patch
        14 kB
        Tom White
      4. hadoop-3566.patch
        19 kB
        Tom White

        Issue Links

          Activity

            People

            • Assignee:
              Tom White
              Reporter:
              Tom White
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development