Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6710

Job CommitterEventHandler waitForValidCommitWindow may wait forever

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.5.0, 2.6.1, 2.8.0, 3.0.0-alpha1
    • Fix Version/s: None
    • Component/s: applicationmaster
    • Labels:
      None
    • Flags:
      Patch, Important

      Description

      The callBack Runnable may run after runOnNextHeartbeat but before wait(), if that happens, it will wait forever.

      So I think the wait() must set timeout.

      CommitterEventHandler#waitForValidCommitWindow
      while (now - lastHeartbeatTime > commitWindowMs) {
      rmHeartbeatHandler.runOnNextHeartbeat(new Runnable() {
      @Override
      public void run() {
      synchronized (EventProcessor.this)

      { EventProcessor.this.notify(); }

      }
      });

      wait();
      lastHeartbeatTime = rmHeartbeatHandler.getLastHeartbeatTime();
      now = context.getClock().getTime();
      }

        Attachments

        1. MAPREDUCE-6710.patch
          1 kB
          ChenFolin

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              chenfolin ChenFolin
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: