Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-314

remove the append phase in sorting the reduce inputs

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.3.2
    • Fix Version/s: 0.4.0
    • Component/s: None
    • Labels:
      None

      Description

      This patch creates a new interface to SequenceFile.sort that allows both a list of files to be passed as input and specifying whether the inputs should be deleted. The ReduceTask is changed to pass the list of map inputs and to delete them as they are sorted.

      1. no-append.patch
        10 kB
        Owen O'Malley

        Activity

        Hide
        cutting Doug Cutting added a comment -

        I just committed this. Thanks, Owen!

        Show
        cutting Doug Cutting added a comment - I just committed this. Thanks, Owen!

          People

          • Assignee:
            owen.omalley Owen O'Malley
            Reporter:
            owen.omalley Owen O'Malley
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development