[TEZ-375] Remove 2 second wait for end of shuffle

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Assignee: Unassigned
• Reporter: Bikas Saha
• Created: 18/Aug/13 06:34
• Updated: 19/Aug/13 23:46
• Resolved: 19/Aug/13 23:46

Description

According to following code Shuffle may wait upto 2 second for completion depending on when the sleep wait starts
PROGRESS_FREQUENCY is 2000 ms.

    while (!scheduler.waitUntilDone(PROGRESS_FREQUENCY)) {
      reporter.progress();
      
      synchronized (this) {
        if (throwable != null) {
          throw new ShuffleError("error in shuffle in " + throwingThreadName,
                                 throwable);
        }
      }
    }