[FLINK-9601] Snapshot of CopyOnWriteStateTable will failed when the amount of record is more than MAXIMUM_CAPACITY

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.6.0
• Fix Version/s: 1.6.0
• Component/s: Runtime / State Backends
• Assignee: Sihua Zhou
• Reporter: Sihua Zhou
• Created: 16/Jun/18 10:06
• Updated: 18/Jun/18 07:53
• Resolved: 18/Jun/18 07:53

Description

In short, the problem is that we reuse the `snaphotData` as the output array when partitioning the input data, but the `snapshotData` is max length is `1 << 30`. So when the records in `CopyOnWriteStateTable` is more than `1 << 30` (e.g. 1 <<30 + 1), then the check `Preconditions.checkState(partitioningDestination.length >= numberOfElements);` could be failed.

Issue Links

• links to: GitHub Pull Request #6174