[UIMA-5843] UIMA-DUCC: pull service should support error window

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0-Ducc
• Component/s: DUCC
• Assignee: Jaroslaw Cwiklik
• Reporter: Jaroslaw Cwiklik
• Created: 24/Jul/18 14:11
• Updated: 30/Jul/18 18:56
• Resolved: 30/Jul/18 18:56

Description

Currently, a pull service terminates on the 1st process error. In some cases, this might not be desirable. Add an error handler which supports an error window. It should be based on max number of errors (ME) in a given window(W). Examples:

(ME,W)

(0,0)  - never terminate on errors 

(1,1) - terminate on first error 

(2, 5) - terminate on second error in a window of 5 tasks

The default will be (1,1). 

For jobs, the Orchestrator will add two new -D's to JP command line if a job spec defines a custom error window

ducc.deploy.service.error.threshold=ME
ducc.deploy.service.error.window=W

An application with an embedded PullService can change the default error window by calling a new method of IServiceProcessor

public void setErrorHandlerWindow(int maxErrors, int windowSize);

 Changes are needed in the job spec to support optional error window properties (max errors and window size). Also, the OR needs to change to add -Ds as mentioned above. Duccbook needs an update as well to document new job properties.