Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
v1.4.0
-
None
Description
streaming_fillgap.sh will try to fill gap when there is some error of the streaming job. But no matter how long the gap it is, how big the missing data it is, kylin tried to fill gap in one thread, which sometimes cause out of memory error. Need streaming_fillgap.sh to be more intelligent based on gap time range and data volume.