Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
With the addition of continuous file monitoring, apart from the StreamSource also the ContinuousFileReaderOperator uses a SourceContext. Given this, all the implementations of the SourceContext should be removed from the StreamSource and become independent classes.
In addition, the AsyncExceptionChecker interface should be removed as its functionality can be replaced by the task.failExternally() method. This also implies slight changes in the source context implementations.
Also in the trigger() method of the WatermarkEmittingTask, all the owner.getCurrentProcessingTime() could be replaced by the timestamp argument of that method. This will remove some of the calls to the getCurrentProcessingTime() which can be expensive.