Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5066

JobTracker should set a timeout when calling into job.end.notification.url

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1-win, 2.0.3-alpha, 1.3.0
    • Fix Version/s: 1.2.0, 1-win, 2.1.0-beta
    • Component/s: None
    • Labels:
      None

      Description

      In current code, timeout is not specified when JobTracker (JobEndNotifier) calls into the notification URL. When the given URL points to a server that will not respond for a long time, job notifications are completely stuck (given that we have only a single thread processing all notifications). We've seen this cause noticeable delays in job execution in components that rely on job end notifications (like Oozie workflows).

      I propose we introduce a configurable timeout option and set a default to a reasonably small value.

      If we want, we can also introduce a configurable number of workers processing the notification queue (not sure if this is needed though at this point).

      I will prepare a patch soon. Please comment back.

      1. MAPREDUCE-5066.patch
        7 kB
        Ivan Mitic
      2. MAPREDUCE-5066.branch-1-win.patch
        16 kB
        Ivan Mitic
      3. MAPREDUCE-5066.branch-1-win.5.patch
        17 kB
        Ivan Mitic
      4. MAPREDUCE-5066.branch-1-win.4.patch
        17 kB
        Ivan Mitic
      5. MAPREDUCE-5066.branch-1-win.3.patch
        16 kB
        Ivan Mitic
      6. MAPREDUCE-5066.branch-1-win.2.patch
        16 kB
        Ivan Mitic
      7. MAPREDUCE-5066.3.patch
        17 kB
        Ivan Mitic
      8. MAPREDUCE-5066.2.patch
        8 kB
        Ivan Mitic

        Issue Links

          Activity

          Brad Liu made changes -
          Link This issue is duplicated by MAPREDUCE-4935 [ MAPREDUCE-4935 ]
          Matt Foley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Target Version/s 1-win, 2.0.5-beta, 1.3.0 [ 12321744, 12324032, 12324153 ] 1.2.0, 1-win, 2.0.5-beta [ 12321661, 12321744, 12324032 ]
          Fix Version/s 1.2.0 [ 12321661 ]
          Fix Version/s 1-win [ 12321744 ]
          Fix Version/s 2.0.5-beta [ 12324032 ]
          Resolution Fixed [ 1 ]
          Arun C Murthy made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Target Version/s 1-win, 1.3.0 [ 12321744, 12324153 ] 1-win, 2.0.5-beta, 1.3.0 [ 12321744, 12324032, 12324153 ]
          Ivan Mitic made changes -
          Attachment MAPREDUCE-5066.3.patch [ 12578673 ]
          Ivan Mitic made changes -
          Attachment MAPREDUCE-5066.branch-1-win.5.patch [ 12578672 ]
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Ivan Mitic made changes -
          Attachment MAPREDUCE-5066.branch-1-win.4.patch [ 12576326 ]
          Attachment MAPREDUCE-5066.2.patch [ 12576327 ]
          Ivan Mitic made changes -
          Attachment MAPREDUCE-5066.branch-1.patch [ 12576322 ]
          Ivan Mitic made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Ivan Mitic made changes -
          Attachment MAPREDUCE-5066.patch [ 12576323 ]
          Ivan Mitic made changes -
          Attachment MAPREDUCE-5066.patch [ 12576324 ]
          Ivan Mitic made changes -
          Attachment MAPREDUCE-5066.branch-1-win.3.patch [ 12576321 ]
          Attachment MAPREDUCE-5066.branch-1.patch [ 12576322 ]
          Attachment MAPREDUCE-5066.patch [ 12576323 ]
          Ivan Mitic made changes -
          Attachment MAPREDUCE-5066.branch-1-win.2.patch [ 12574097 ]
          Ivan Mitic made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Ivan Mitic made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Ivan Mitic made changes -
          Attachment MAPREDUCE-5066.branch-1-win.patch [ 12574085 ]
          Hitesh Shah made changes -
          Field Original Value New Value
          Affects Version/s 2.0.3-alpha [ 12323275 ]
          Ivan Mitic created issue -

            People

            • Assignee:
              Ivan Mitic
              Reporter:
              Ivan Mitic
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development