Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3493

Add the default mapreduce.shuffle.port property to mapred-default.xml

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: 2.0.2-alpha
    • Component/s: mrv2
    • Labels:
    • Hadoop Flags:
      Reviewed

      Description

      I faced this issue when trying to run multiple Hadoop MR2 instances on the same node. The default value for this property is hardcoded in the ShuffleHandler.java class so it results in port conflicts. The issue is resolved if you set the property value in your conf files. But the absence of this property from *-default.xml files is confusing. So It'll be cleaner to move this property to mapred-default.xml, so its default value can be easily identified and changed if needed.

      1. MAPREDUCE-3943-4.patch
        0.9 kB
        Harsh J
      2. MAPREDUCE-3943-4.patch
        0.9 kB
        Harsh J
      3. MAPREDUCE-3493-3.patch
        0.6 kB
        madhukara phatak
      4. MAPREDUCE-3493-2.patch
        0.6 kB
        madhukara phatak
      5. MAPREDUCE-3493-1.patch
        0.5 kB
        madhukara phatak
      6. MAPREDUCE-3493.patch
        0.5 kB
        madhukara phatak

        Activity

        Ahmed Radwan created issue -
        Ahmed Radwan made changes -
        Field Original Value New Value
        Affects Version/s 0.23.0 [ 12315570 ]
        Component/s mrv2 [ 12314301 ]
        Harsh J made changes -
        Labels newbie
        madhukara phatak made changes -
        Attachment MAPREDUCE-3493.patch [ 12521459 ]
        madhukara phatak made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        madhukara phatak made changes -
        Attachment MAPREDUCE-3493-1.patch [ 12521983 ]
        madhukara phatak made changes -
        Attachment MAPREDUCE-3493-2.patch [ 12522114 ]
        madhukara phatak made changes -
        Attachment MAPREDUCE-3493-3.patch [ 12522120 ]
        Harsh J made changes -
        Hadoop Flags Reviewed [ 10343 ]
        Assignee Ahmed Radwan [ ahmed.radwan ]
        Target Version/s 2.0.0 [ 12320354 ]
        Harsh J made changes -
        Attachment MAPREDUCE-3943-4.patch [ 12522419 ]
        Harsh J made changes -
        Attachment MAPREDUCE-3943-4.patch [ 12530040 ]
        Harsh J made changes -
        Affects Version/s 2.0.0-alpha [ 12320354 ]
        Affects Version/s 0.23.0 [ 12315570 ]
        Target Version/s 2.0.0-alpha [ 12320354 ] 2.0.1-alpha, 3.0.0 [ 12321442, 12320355 ]
        Harsh J made changes -
        Resolution Fixed [ 1 ]
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Target Version/s 2.0.1-alpha, 3.0.0 [ 12321442, 12320355 ]
        Fix Version/s 2.0.1-alpha [ 12321442 ]
        Arun C Murthy made changes -
        Fix Version/s 2.0.2-alpha [ 12322471 ]
        Fix Version/s 2.1.0-alpha [ 12321442 ]
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Unassigned
            Reporter:
            Ahmed Radwan
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development