Details

    • Type: New Feature New Feature
    • Status: Reopened
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: applicationmaster, mrv2
    • Labels:
      None

      Description

      It would be nice if we could add method to OutputFormat that would allow a job to indicate where a reducer for a given partition should should run. This is similar to the getSplits() method on InputFormat. In our application the reducer is using other data in addition to the map outputs during processing and data accesses could be made more efficient if the JobTracker scheduled the reducers to run on specific hosts.

      1. MAPREDUCE-199.patch
        6 kB
        Harsh J
      2. MAPREDUCE-199.patch
        6 kB
        Harsh J

        Issue Links

          Activity

          Harsh J made changes -
          Attachment MAPREDUCE-199.patch [ 12544391 ]
          Harsh J made changes -
          Assignee Harsh J [ qwertymaniac ]
          Harsh J made changes -
          Attachment MAPREDUCE-199.patch [ 12544389 ]
          Vinod Kumar Vavilapalli made changes -
          Link This issue blocks MAPREDUCE-3719 [ MAPREDUCE-3719 ]
          Vinod Kumar Vavilapalli made changes -
          Link This issue blocks MAPREDUCE-3719 [ MAPREDUCE-3719 ]
          Arun C Murthy made changes -
          Component/s applicationmaster [ 12315625 ]
          Component/s mrv2 [ 12314301 ]
          Arun C Murthy made changes -
          Resolution Won't Fix [ 2 ]
          Status Resolved [ 5 ] Reopened [ 4 ]
          Assignee Owen O'Malley [ owen.omalley ]
          Harsh J made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Won't Fix [ 2 ]
          Owen O'Malley made changes -
          Project Hadoop Common [ 12310240 ] Hadoop Map/Reduce [ 12310941 ]
          Key HADOOP-589 MAPREDUCE-199
          Component/s mapred [ 12310690 ]
          Billy Pearson made changes -
          Link This issue blocks HBASE-1199 [ HBASE-1199 ]
          Doug Cutting made changes -
          Field Original Value New Value
          Assignee Owen O'Malley [ owen.omalley ]
          Benjamin Reed created issue -

            People

            • Assignee:
              Harsh J
              Reporter:
              Benjamin Reed
            • Votes:
              6 Vote for this issue
              Watchers:
              27 Start watching this issue

              Dates

              • Created:
                Updated:

                Development