Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4808

Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.3-alpha
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Now that Shuffle is pluggable (MAPREDUCE-4049), it would be convenient for alternate implementations to be able to reuse portions of the default implementation.

      This would come with the strong caveat that these classes are LimitedPrivate and Unstable.

        Attachments

        1. COMBO-mapreduce-4809-4812-4808.patch
          84 kB
          Mariappan Asokan
        2. M4808-0.patch
          103 kB
          Chris Douglas
        3. M4808-1.patch
          103 kB
          Chris Douglas
        4. mapreduce-4808.patch
          45 kB
          Mariappan Asokan
        5. mapreduce-4808.patch
          62 kB
          Mariappan Asokan
        6. mapreduce-4808.patch
          61 kB
          Mariappan Asokan
        7. mapreduce-4808.patch
          78 kB
          Mariappan Asokan
        8. mapreduce-4808.patch
          71 kB
          Mariappan Asokan
        9. mapreduce-4808.patch
          67 kB
          Mariappan Asokan
        10. mapreduce-4808.patch
          67 kB
          Mariappan Asokan
        11. mapreduce-4808.patch
          39 kB
          Mariappan Asokan
        12. MergeManagerPlugin.pdf
          47 kB
          Mariappan Asokan
        13. MR-4808.patch
          51 kB
          Alejandro Abdelnur

          Issue Links

            Activity

              People

              • Assignee:
                masokan Mariappan Asokan
                Reporter:
                acmurthy Arun C Murthy
              • Votes:
                0 Vote for this issue
                Watchers:
                20 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: