Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2454

Allow external sorter plugin for MR

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 2.0.0-alpha, 2.0.2-alpha, 3.0.0-alpha1
    • 2.0.3-alpha
    • None
    • MAPREDUCE-4807 Allow external implementations of the sort phase in a Map task

    Description

      Define interfaces and some abstract classes in the Hadoop framework to facilitate external sorter plugins both on the Map and Reduce sides.

      Attachments

        1. HadoopSortPlugin.pdf
          56 kB
          Mariappan Asokan
        2. HadoopSortPlugin.pdf
          61 kB
          Mariappan Asokan
        3. KeyValueIterator.java
          1 kB
          Mariappan Asokan
        4. MapOutputSorter.java
          1 kB
          Mariappan Asokan
        5. MapOutputSorterAbstract.java
          5 kB
          Mariappan Asokan
        6. mapreduce-2454.patch
          106 kB
          Mariappan Asokan
        7. mapreduce-2454.patch
          106 kB
          Mariappan Asokan
        8. mapreduce-2454.patch
          105 kB
          Mariappan Asokan
        9. mapreduce-2454.patch
          104 kB
          Mariappan Asokan
        10. mapreduce-2454.patch
          104 kB
          Mariappan Asokan
        11. mapreduce-2454.patch
          102 kB
          Mariappan Asokan
        12. mapreduce-2454.patch
          69 kB
          Mariappan Asokan
        13. mapreduce-2454.patch
          68 kB
          Mariappan Asokan
        14. mapreduce-2454.patch
          68 kB
          Mariappan Asokan
        15. mapreduce-2454.patch
          281 kB
          Mariappan Asokan
        16. mapreduce-2454.patch
          281 kB
          Mariappan Asokan
        17. mapreduce-2454.patch
          281 kB
          Mariappan Asokan
        18. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        19. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        20. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        21. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        22. mapreduce-2454.patch
          280 kB
          Mariappan Asokan
        23. mapreduce-2454.patch
          246 kB
          Mariappan Asokan
        24. mapreduce-2454.patch
          250 kB
          Mariappan Asokan
        25. mapreduce-2454.patch
          248 kB
          Mariappan Asokan
        26. mapreduce-2454.patch
          244 kB
          Mariappan Asokan
        27. mapreduce-2454-modified-code.patch
          67 kB
          Mariappan Asokan
        28. mapreduce-2454-modified-test.patch
          1 kB
          Mariappan Asokan
        29. mapreduce-2454-new-test.patch
          33 kB
          Mariappan Asokan
        30. mapreduce-2454-protection-change.patch
          6 kB
          Mariappan Asokan
        31. mr-2454-on-mr-279-build82.patch.gz
          44 kB
          Mariappan Asokan
        32. MR-2454-trunkPatchPreview.gz
          48 kB
          Mariappan Asokan
        33. ReduceInputSorter.java
          5 kB
          Mariappan Asokan

        Issue Links

          is depended upon by

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-1639 Grouping using hashing instead of sorting

          • Major - Major loss of function.
          • Open
          is related to

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-4482 Backport MR sort plugin(MAPREDUCE-2454) to Hadoop 1.2

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue MAPREDUCE-4049 plugin for generic shuffle service

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-4039 Sort Avoidance

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-4891 Pluggable merge at reduce side

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              masokan Mariappan Asokan
              masokan Mariappan Asokan
              Votes:
              0 Vote for this issue
              Watchers:
              52 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: