[NUTCH-2076] exceptions are not handled when using method waitForCompletion in a try block

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Auto Closed
• Affects Version/s: 2.2, 2.3
• Fix Version/s: 2.5
• Component/s: crawldb
• Assignee: Unassigned
• Reporter: songwanging
• Created: 10/Aug/15 21:53
• Updated: 22/Nov/19 15:27
• Resolved: 22/Nov/19 13:21

Description

Locations: src\java\org\apache\nutch\crawl\WebTableReader.java
when using function waitForCompletion in a try block, exceptions are not handled :

waitForCompletion might throw : IOException, InterruptedException, ClassNotFoundException
so when calling this function in a try block, we should use a catch block to handle potential Exceptions.

public Map<String, Object> run(Map<String, Object> args) throws Exception {
...
try

{ currentJob.waitForCompletion(true); }

finally {
ToolUtil.recordJobStatus(null, currentJob, results);
if (!currentJob.isSuccessful())

{ fileSystem.delete(tmpFolder, true); return results; }

}
...
}

Issue Links

• is related to: NUTCH-2442 Injector to stop if job fails to avoid loss of CrawlDb