Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2602

Allow setting of end-of-record delimiter for TextInputFormat (for the old API)

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.23.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Since there are users who are still using the old MR API, it will be useful to modify the org.apache.hadoop.mapred.LineRecordReader and org.apache.hadoop.mapred.TextInputFormat to be able to use custom (user-specified) end-of-record delimiters. This will make use of the LineReader improvement introduced in HADOOP-7096 that enables the LineReader to break lines at user-specified delimiters.

      Note: MAPREDUCE-2254 already added this improvement to the new API (but not the old API).

      1. MAPREDUCE-2602.patch
        10 kB
        Ahmed Radwan
      2. MAPREDUCE-2602_rev2.patch
        10 kB
        Ahmed Radwan

        Activity

        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Todd Lipcon made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Fix Version/s 0.23.0 [ 12315570 ]
        Resolution Fixed [ 1 ]
        Ahmed Radwan made changes -
        Attachment MAPREDUCE-2602_rev2.patch [ 12485529 ]
        Ahmed Radwan made changes -
        Attachment MAPREDUCE-2602.patch [ 12482890 ]
        Ahmed Radwan made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Ahmed Radwan made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Ahmed Radwan made changes -
        Field Original Value New Value
        Status Open [ 1 ] Patch Available [ 10002 ]
        Ahmed Radwan created issue -

          People

          • Assignee:
            Ahmed Radwan
            Reporter:
            Ahmed Radwan
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development