Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3382

Network ACLs can prevent AMs to ping the Job-end notification URL

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.23.0
    • 0.23.1
    • applicationmaster, mrv2
    • None
    • Reviewed
    • Enhanced MR AM to use a proxy to ping the job-end notification URL.

    Description

      MAPREDUCE-3028 added support for job-end notification from MR AMs after the job finishes. Network ACLs can have an implication on this one - outgoing connections from the compute nodes may be restricted in some settings and so job-end notification( that can originate from the AMs which may run on random nodes in the cluster) may have issues.

      Attachments

        1. MAPREDUCE-3382.branch-0.23.patch
          5 kB
          Ravi Prakash
        2. MAPREDUCE-3382.branch-0.23.patch
          6 kB
          Ravi Prakash

        Activity

          People

            raviprak Ravi Prakash
            vinodkv Vinod Kumar Vavilapalli
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: