[HOP-3959] Dynamic labels are not correctly handled in Neo4j output step

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.2.0
• Fix Version/s: 2.0.0
• Component/s: Plugins
• Labels: pull-request-available
• Environment: Mac OS Monterey, OpenJDK11
• Assignee: Matt Casters
• Reporter: Nelson sousa
• Created: 24/May/22 14:41
• Updated: 26/May/22 11:14
• Resolved: 26/May/22 11:14

Description

When generating data with dynamic labels hop takes the labels from the previous rows, compares with the current ones and then determines whether to use the previous ones or not.

 

However, this routine fails if we're writing large amounts of data (thousands of nodes).

Example: 2k nodes with labels DE and Adult, followed by 1k nodes DE Child, 1k nodes DE Baby

 

The clone rows step on the sample hpl allows choosing larger or smaller rowsets. with 99 clones (800 nodes in total) all behaviours are as expected. But with 999 clones the issue becomes visible.

 

It's also worth having a look at dynamic labels for relationships, as they're probably equally affected, but I haven't tested those.

Issue Links

• links to: GitHub pull request #1502