Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2652

MR-279: Cannot run multiple NMs on a single node

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: mrv2
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently in MR-279 the Auxiliary services, like ShuffleHandler, have no way to communicate information back to the applications. Because of this the Map Reduce Application Master has hardcoded in a port of 8080 for shuffle. This prevents the configuration "mapreduce.shuffle.port" form ever being set to anything but 8080. The code should be updated to allow this information to be returned to the application master. Also the data needs to be persisted to the task log so that on restart the data is not lost.

        Attachments

        1. MR-2652-v2.txt
          30 kB
          Robert Joseph Evans
        2. MR-2652-v1.txt
          24 kB
          Robert Joseph Evans
        3. MR-2652-trunk-v4.patch
          46 kB
          Robert Joseph Evans
        4. MR-2652-trunk-v3.patch
          33 kB
          Robert Joseph Evans
        5. MAPREDUCE-2652-20110831.txt
          48 kB
          Vinod Kumar Vavilapalli

          Issue Links

            Activity

              People

              • Assignee:
                revans2 Robert Joseph Evans
                Reporter:
                revans2 Robert Joseph Evans
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: