Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2454

Allow external sorter plugin for MR

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 2.0.0-alpha, 2.0.2-alpha, 3.0.0-alpha1
    • 2.0.3-alpha
    • None
    • MAPREDUCE-4807 Allow external implementations of the sort phase in a Map task

    Description

      Define interfaces and some abstract classes in the Hadoop framework to facilitate external sorter plugins both on the Map and Reduce sides.

      Attachments

        1. MapOutputSorter.java
          1 kB
          Mariappan Asokan
        2. ReduceInputSorter.java
          5 kB
          Mariappan Asokan
        3. MapOutputSorterAbstract.java
          5 kB
          Mariappan Asokan
        4. KeyValueIterator.java
          1 kB
          Mariappan Asokan
        5. MR-2454-trunkPatchPreview.gz
          48 kB
          Mariappan Asokan
        6. HadoopSortPlugin.pdf
          61 kB
          Mariappan Asokan
        7. mr-2454-on-mr-279-build82.patch.gz
          44 kB
          Mariappan Asokan
        8. mapreduce-2454.patch
          244 kB
          Mariappan Asokan
        9. mapreduce-2454.patch
          248 kB
          Mariappan Asokan
        10. mapreduce-2454.patch
          250 kB
          Mariappan Asokan
        11. mapreduce-2454.patch
          246 kB
          Mariappan Asokan
        12. HadoopSortPlugin.pdf
          56 kB
          Mariappan Asokan
        13. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        14. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        15. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        16. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        17. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        18. mapreduce-2454.patch
          281 kB
          Mariappan Asokan
        19. mapreduce-2454.patch
          281 kB
          Mariappan Asokan
        20. mapreduce-2454.patch
          281 kB
          Mariappan Asokan
        21. mapreduce-2454.patch
          68 kB
          Mariappan Asokan
        22. mapreduce-2454.patch
          68 kB
          Mariappan Asokan
        23. mapreduce-2454.patch
          69 kB
          Mariappan Asokan
        24. mapreduce-2454.patch
          102 kB
          Mariappan Asokan
        25. mapreduce-2454.patch
          104 kB
          Mariappan Asokan
        26. mapreduce-2454.patch
          104 kB
          Mariappan Asokan
        27. mapreduce-2454.patch
          105 kB
          Mariappan Asokan
        28. mapreduce-2454-modified-code.patch
          67 kB
          Mariappan Asokan
        29. mapreduce-2454-modified-test.patch
          1 kB
          Mariappan Asokan
        30. mapreduce-2454-new-test.patch
          33 kB
          Mariappan Asokan
        31. mapreduce-2454-protection-change.patch
          6 kB
          Mariappan Asokan
        32. mapreduce-2454.patch
          106 kB
          Mariappan Asokan
        33. mapreduce-2454.patch
          106 kB
          Mariappan Asokan

        Issue Links

        is depended upon by

        New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-1639 Grouping using hashing instead of sorting

        • Major - Major loss of function.
        • Open
        is related to

        New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-4482 Backport MR sort plugin(MAPREDUCE-2454) to Hadoop 1.2

        • Major - Major loss of function.
        • Resolved
        relates to

        Sub-task - The sub-task of the issue MAPREDUCE-4049 plugin for generic shuffle service

        • Major - Major loss of function.
        • Closed

        New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-4039 Sort Avoidance

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Open

        New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-4891 Pluggable merge at reduce side

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            masokan Mariappan Asokan
            masokan Mariappan Asokan
            Votes:
            0 Vote for this issue
            Watchers:
            52 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment