[FLINK-17878] Transient watermark attribute should be initial at runtime in streaming file operators

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.11.0
• Fix Version/s: 1.11.0
• Component/s: Connectors / FileSystem
• Labels: pull-request-available
• Assignee: xiaogang zhou
• Reporter: xiaogang zhou
• Created: 22/May/20 07:37
• Updated: 25/May/20 02:28
• Resolved: 25/May/20 02:28

Description

StreamingFileWriter has a 

private transient long currentWatermark = Long.MIN_VALUE;

 

in case developer wants to create a custom bucket assigner, it will receive a currentWatermark as 0, this might be conflict with the original flink approach to handle a min_long.

 

should we remove the transient key word?

 

Issue Links

• duplicates: FLINK-17885 StreamingFileCommitter watermark attribute is transient, this might be different with origin value
• links to: GitHub Pull Request #12293
• links to: GitHub Pull Request #12299