Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3493

Add the default mapreduce.shuffle.port property to mapred-default.xml

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 2.0.0-alpha
    • 2.0.2-alpha
    • mrv2
    • Reviewed

    Description

      I faced this issue when trying to run multiple Hadoop MR2 instances on the same node. The default value for this property is hardcoded in the ShuffleHandler.java class so it results in port conflicts. The issue is resolved if you set the property value in your conf files. But the absence of this property from *-default.xml files is confusing. So It'll be cleaner to move this property to mapred-default.xml, so its default value can be easily identified and changed if needed.

      Attachments

        1. MAPREDUCE-3493.patch
          0.5 kB
          madhukara phatak
        2. MAPREDUCE-3493-1.patch
          0.5 kB
          madhukara phatak
        3. MAPREDUCE-3493-2.patch
          0.6 kB
          madhukara phatak
        4. MAPREDUCE-3493-3.patch
          0.6 kB
          madhukara phatak
        5. MAPREDUCE-3943-4.patch
          0.9 kB
          Harsh J
        6. MAPREDUCE-3943-4.patch
          0.9 kB
          Harsh J

        Activity

          People

            Unassigned Unassigned
            ahmed.radwan Ahmed Radwan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: