Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6710

Job CommitterEventHandler waitForValidCommitWindow may wait forever

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 2.5.0, 2.6.1, 2.8.0, 3.0.0-alpha1
    • None
    • applicationmaster
    • None
    • Patch, Important

    Description

      The callBack Runnable may run after runOnNextHeartbeat but before wait(), if that happens, it will wait forever.

      So I think the wait() must set timeout.

      CommitterEventHandler#waitForValidCommitWindow
      while (now - lastHeartbeatTime > commitWindowMs) {
      rmHeartbeatHandler.runOnNextHeartbeat(new Runnable() {
      @Override
      public void run() {
      synchronized (EventProcessor.this)

      { EventProcessor.this.notify(); }

      }
      });

      wait();
      lastHeartbeatTime = rmHeartbeatHandler.getLastHeartbeatTime();
      now = context.getClock().getTime();
      }

      Attachments

        1. MAPREDUCE-6710.patch
          1 kB
          ChenFolin

        Activity

          People

            Unassigned Unassigned
            chenfolin ChenFolin
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: