Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3493

Add the default mapreduce.shuffle.port property to mapred-default.xml

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: 2.0.2-alpha
    • Component/s: mrv2
    • Labels:
    • Hadoop Flags:
      Reviewed

      Description

      I faced this issue when trying to run multiple Hadoop MR2 instances on the same node. The default value for this property is hardcoded in the ShuffleHandler.java class so it results in port conflicts. The issue is resolved if you set the property value in your conf files. But the absence of this property from *-default.xml files is confusing. So It'll be cleaner to move this property to mapred-default.xml, so its default value can be easily identified and changed if needed.

      1. MAPREDUCE-3943-4.patch
        0.9 kB
        Harsh J
      2. MAPREDUCE-3943-4.patch
        0.9 kB
        Harsh J
      3. MAPREDUCE-3493-3.patch
        0.6 kB
        madhukara phatak
      4. MAPREDUCE-3493-2.patch
        0.6 kB
        madhukara phatak
      5. MAPREDUCE-3493-1.patch
        0.5 kB
        madhukara phatak
      6. MAPREDUCE-3493.patch
        0.5 kB
        madhukara phatak

        Activity

          People

          • Assignee:
            Unassigned
            Reporter:
            Ahmed Radwan
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development