Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4808

Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.3-alpha
    • None
    • None
    • Reviewed

    Description

      Now that Shuffle is pluggable (MAPREDUCE-4049), it would be convenient for alternate implementations to be able to reuse portions of the default implementation.

      This would come with the strong caveat that these classes are LimitedPrivate and Unstable.

      Attachments

        1. MR-4808.patch
          51 kB
          Alejandro Abdelnur
        2. MergeManagerPlugin.pdf
          47 kB
          Mariappan Asokan
        3. mapreduce-4808.patch
          39 kB
          Mariappan Asokan
        4. mapreduce-4808.patch
          67 kB
          Mariappan Asokan
        5. mapreduce-4808.patch
          67 kB
          Mariappan Asokan
        6. mapreduce-4808.patch
          71 kB
          Mariappan Asokan
        7. mapreduce-4808.patch
          78 kB
          Mariappan Asokan
        8. mapreduce-4808.patch
          61 kB
          Mariappan Asokan
        9. mapreduce-4808.patch
          62 kB
          Mariappan Asokan
        10. mapreduce-4808.patch
          45 kB
          Mariappan Asokan
        11. M4808-1.patch
          103 kB
          Christopher Douglas
        12. M4808-0.patch
          103 kB
          Christopher Douglas
        13. COMBO-mapreduce-4809-4812-4808.patch
          84 kB
          Mariappan Asokan

        Issue Links

        relates to

        New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-6332 Provide facility to users for writting custom MergeManager implementation when custom shuffleconsumerPluggin is used

        • Major - Major loss of function.
        • Open

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            masokan Mariappan Asokan
            acmurthy Arun Murthy
            Votes:
            0 Vote for this issue
            Watchers:
            19 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment