Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-433

Better access to the RecordReader

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Duplicate
    • 0.5.0
    • 0.13.0
    • None
    • None

    Description

      The record reader has access to the FileSplit which can in turn have information that is useful to the Mapper. For example, Map processing may vary according to file name or attributes associated with a file. Unfortunately, even using a MapRunner you only have access to the progress wrapper of the RecordReader. To get access to the real record reader I had to use a thread local variable which I set in RecordReader.getNext(). It would be much nicer if you could get a reference to the real RecordReader from the RecordReader passed to MapRunner.

      Attachments

        Activity

          People

            Unassigned Unassigned
            breed Benjamin Reed
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: