Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2652

MR-279: Cannot run multiple NMs on a single node

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: mrv2
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently in MR-279 the Auxiliary services, like ShuffleHandler, have no way to communicate information back to the applications. Because of this the Map Reduce Application Master has hardcoded in a port of 8080 for shuffle. This prevents the configuration "mapreduce.shuffle.port" form ever being set to anything but 8080. The code should be updated to allow this information to be returned to the application master. Also the data needs to be persisted to the task log so that on restart the data is not lost.

      1. MR-2652-v1.txt
        24 kB
        Robert Joseph Evans
      2. MR-2652-v2.txt
        30 kB
        Robert Joseph Evans
      3. MR-2652-trunk-v3.patch
        33 kB
        Robert Joseph Evans
      4. MR-2652-trunk-v4.patch
        46 kB
        Robert Joseph Evans
      5. MAPREDUCE-2652-20110831.txt
        48 kB
        Vinod Kumar Vavilapalli

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Robert Joseph Evans
              Reporter:
              Robert Joseph Evans
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development