[ATLAS-3799] Migration Import: EntityConsumer Adds GUIDs to Result that Will Not Get Cleared

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: trunk
• Fix Version/s: trunk
• Component/s: atlas-core
• Assignee: Ashutosh Mestry
• Reporter: Ashutosh Mestry
• Created: 14/May/20 22:06
• Updated: 02/Jun/20 20:36
• Resolved: 18/May/20 04:54

Description

Background

Zip file-based migration import introduced EntityConsumer. This uses StatusReporter that is used to determine which which of the produced items are processed. This, in turn, helps determine the right position to set in case of resuming the import.

The EntityConumer class is responsible for adding the right GUIDs to the result that helps StatusReporter determine the right GUIDs. This is done correctly except that it also adds additional GUIDs that were updated or deleted. This causes StatusReporter.processedSet to be filled with GUIDs that will never be cleared. This will grow over time and can potentially lead to memory pressure.

Solution

Add only the GUIDs that were processed.