Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3382

Network ACLs can prevent AMs to ping the Job-end notification URL

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.1
    • Component/s: applicationmaster, mrv2
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Enhanced MR AM to use a proxy to ping the job-end notification URL.

      Description

      MAPREDUCE-3028 added support for job-end notification from MR AMs after the job finishes. Network ACLs can have an implication on this one - outgoing connections from the compute nodes may be restricted in some settings and so job-end notification( that can originate from the AMs which may run on random nodes in the cluster) may have issues.

        Activity

        Vinod Kumar Vavilapalli created issue -
        Ravi Prakash made changes -
        Field Original Value New Value
        Assignee Ravi Prakash [ raviprak ]
        Ravi Prakash made changes -
        Attachment MAPREDUCE-3382.branch-0.23.patch [ 12509721 ]
        Ravi Prakash made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Ravi Prakash made changes -
        Attachment MAPREDUCE-3382.branch-0.23.patch [ 12509748 ]
        Ravi Prakash made changes -
        Priority Major [ 3 ] Critical [ 2 ]
        Vinod Kumar Vavilapalli made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Release Note Enhanced MR AM to use a proxy to ping the job-end notification URL.
        Resolution Fixed [ 1 ]
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Ravi Prakash
            Reporter:
            Vinod Kumar Vavilapalli
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development