Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Invalid
-
v1.4.0
-
None
-
None
-
None
Description
Consider the case where streaming's input queue stopped for a while, and Kylin streaming builds empty segments out of it. Later the input queue's issue was fixed however Kylin streaming will never look back to it.
It issue gets worse when the empty segments are later merged with other non-empty segments. After merging, we'll have no clue that empty segments ever existed.
Attachments
Issue Links
- Is contained by
-
KYLIN-924 Kylin Streaming data quality
- Closed