Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-267

Rack level copy of map outputs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      In case of maps taking of lot of time to complete, a rack level copy of the map output can be maintained so that incase of master node for that map goes down the other copy can be served. This will be useful since re-executing the map can be time consuming and rack-level copy is much cheaper than network-level copy.

      Attachments

        Issue Links

          depends upon

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-1985 Abstract node to switch mapping into a topology service class used by namenode and jobtracker

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              amar_kamat Amar Kamat
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: