Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-450

Remove the need for users to specify the types of the inputs

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.5.0
    • 0.6.0
    • None
    • None

    Description

      Currently, the application specifies the types of the input keys and values and the RecordReader checks them for consistency. It would make more sense to have the RecordReader define the types of keys that it will produce. Therefore, I propose that we add two new methods to RecordReader:

      WritableComparable createKey();
      Writable createValue();

      Note that I propose adding them to the RecordReader rather than the InputFormat, so that they can specific to a particular input split.

      Attachments

        1. no-input-type.patch
          29 kB
          Owen O'Malley

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            omalley Owen O'Malley
            omalley Owen O'Malley
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment