Hadoop Common
  1. Hadoop Common
  2. HADOOP-314

remove the append phase in sorting the reduce inputs

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.3.2
    • Fix Version/s: 0.4.0
    • Component/s: None
    • Labels:
      None

      Description

      This patch creates a new interface to SequenceFile.sort that allows both a list of files to be passed as input and specifying whether the inputs should be deleted. The ReduceTask is changed to pass the list of map inputs and to delete them as they are sorted.

      1. no-append.patch
        10 kB
        Owen O'Malley

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Resolved Resolved
        3h 24m 1 Doug Cutting 23/Jun/06 03:14
        Resolved Resolved Closed Closed
        6d 2h 13m 1 Doug Cutting 29/Jun/06 05:27
        Owen O'Malley made changes -
        Component/s mapred [ 12310690 ]
        Doug Cutting made changes -
        Workflow no-reopen-closed [ 12374243 ] no-reopen-closed, patch-avail [ 12377826 ]
        Doug Cutting made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Doug Cutting made changes -
        Resolution Fixed [ 1 ]
        Status Open [ 1 ] Resolved [ 5 ]
        Hide
        Doug Cutting added a comment -

        I just committed this. Thanks, Owen!

        Show
        Doug Cutting added a comment - I just committed this. Thanks, Owen!
        Owen O'Malley made changes -
        Field Original Value New Value
        Attachment no-append.patch [ 12335782 ]
        Owen O'Malley created issue -

          People

          • Assignee:
            Owen O'Malley
            Reporter:
            Owen O'Malley
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development