[GEODE-10067] WANCopyRegionFunctionDelegate needs to be optimized to handle large regions

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.15.0
• Fix Version/s: 1.15.0
• Component/s: wan
• Labels: pull-request-available
• Assignee: Alberto Gomez
• Reporter: Udo Kohlmeyer
• Created: 19/Feb/22 00:43
• Updated: 22/Jun/22 20:46
• Resolved: 18/Mar/22 07:37

Description

The current WanCopyRegionFunctionDelegate may cause significant memory issues in with really large regions.

The getEntries method returns both primary and redundant Region Entries for local server.

The invocation of getEntries from the PartitionedRegionDataStore will cause all entries to be deserialized https://github.com/apache/geode/blob/develop/geode-core/src/main/java/org/apache/geode/internal/cache/PartitionedRegionDataStore.java#L2501-L2515

The createBatch method creates a List<GatewayQueueEvent> equally that of the local Region size.

Essentially ... In a system with VERY large regions this might cause significant memory issues

 

Issue Links

• links to: GitHub Pull Request #7420