Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2454

Allow external sorter plugin for MR

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha, 2.0.2-alpha, 3.0.0-alpha1
    • Fix Version/s: 2.0.3-alpha
    • Component/s: None
    • Target Version/s:
    • Release Note:
      MAPREDUCE-4807 Allow external implementations of the sort phase in a Map task

      Description

      Define interfaces and some abstract classes in the Hadoop framework to facilitate external sorter plugins both on the Map and Reduce sides.

        Attachments

        1. MapOutputSorter.java
          1 kB
          Mariappan Asokan
        2. ReduceInputSorter.java
          5 kB
          Mariappan Asokan
        3. MapOutputSorterAbstract.java
          5 kB
          Mariappan Asokan
        4. KeyValueIterator.java
          1 kB
          Mariappan Asokan
        5. MR-2454-trunkPatchPreview.gz
          48 kB
          Mariappan Asokan
        6. HadoopSortPlugin.pdf
          61 kB
          Mariappan Asokan
        7. mr-2454-on-mr-279-build82.patch.gz
          44 kB
          Mariappan Asokan
        8. mapreduce-2454.patch
          244 kB
          Mariappan Asokan
        9. mapreduce-2454.patch
          248 kB
          Mariappan Asokan
        10. mapreduce-2454.patch
          250 kB
          Mariappan Asokan
        11. mapreduce-2454.patch
          246 kB
          Mariappan Asokan
        12. HadoopSortPlugin.pdf
          56 kB
          Mariappan Asokan
        13. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        14. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        15. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        16. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        17. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        18. mapreduce-2454.patch
          281 kB
          Mariappan Asokan
        19. mapreduce-2454.patch
          281 kB
          Mariappan Asokan
        20. mapreduce-2454.patch
          281 kB
          Mariappan Asokan
        21. mapreduce-2454.patch
          68 kB
          Mariappan Asokan
        22. mapreduce-2454.patch
          68 kB
          Mariappan Asokan
        23. mapreduce-2454.patch
          69 kB
          Mariappan Asokan
        24. mapreduce-2454.patch
          102 kB
          Mariappan Asokan
        25. mapreduce-2454.patch
          104 kB
          Mariappan Asokan
        26. mapreduce-2454.patch
          104 kB
          Mariappan Asokan
        27. mapreduce-2454.patch
          105 kB
          Mariappan Asokan
        28. mapreduce-2454-modified-code.patch
          67 kB
          Mariappan Asokan
        29. mapreduce-2454-modified-test.patch
          1 kB
          Mariappan Asokan
        30. mapreduce-2454-new-test.patch
          33 kB
          Mariappan Asokan
        31. mapreduce-2454-protection-change.patch
          6 kB
          Mariappan Asokan
        32. mapreduce-2454.patch
          106 kB
          Mariappan Asokan
        33. mapreduce-2454.patch
          106 kB
          Mariappan Asokan

          Issue Links

          is depended upon by

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-1639 Grouping using hashing instead of sorting

          • Major - Major loss of function.
          • Open
          is related to

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-4482 Backport MR sort plugin(MAPREDUCE-2454) to Hadoop 1.2

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue MAPREDUCE-4049 plugin for generic shuffle service

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-4039 Sort Avoidance

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-4891 Pluggable merge at reduce side

          • Major - Major loss of function.
          • Resolved
          There are no Sub-Tasks for this issue.

            Activity

              People

              • Assignee:
                masokan Mariappan Asokan
                Reporter:
                masokan Mariappan Asokan
              • Votes:
                0 Vote for this issue
                Watchers:
                53 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: