[NIFI-6285] Data fails to swap in if Load Balancing Strategy is changed while the data is swapped out

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.9.0, 1.9.1, 1.9.2
• Fix Version/s: 1.10.0
• Component/s: Core Framework
• Assignee: Mark Payne
• Reporter: Mark Payne
• Created: 09/May/19 20:29
• Updated: 22/Aug/19 17:03
• Resolved: 14/May/19 19:32

Description

If data is swapped out in a connection, and the connection's Load Balance Strategy is then changed, the data fails to swap back in. I see the following log messages:

2019-05-09 15:59:54,633 WARN [main] o.a.n.controller.FileSystemSwapManager Encountered unknown Swap File ./flowfile_repository/swap/1557431864223-9e237e10-016a-1000-06cb-e202396d758c-02cf72f0-1c0b-4771-8ef7-a708ed1d9de5.rebalance.swap; will ignore this Swap File. This file should be cleaned up manually
2019-05-09 15:59:54,633 WARN [main] o.a.n.controller.FileSystemSwapManager Encountered unknown Swap File ./flowfile_repository/swap/1557431862791-9e237e10-016a-1000-06cb-e202396d758c-1c0c0a53-97d3-4703-b8de-6c7d6295e23a.rebalance.swap; will ignore this Swap File. This file should be cleaned up manually
2019-05-09 15:59:54,633 WARN [main] o.a.n.controller.FileSystemSwapManager Encountered unknown Swap File ./flowfile_repository/swap/1557431866657-9e237e10-016a-1000-06cb-e202396d758c-a6573e52-1758-475f-a0a9-eee211bb7b26.rebalance.swap; will ignore this Swap File. This file should be cleaned up manually

 

To recreate, create a cluster and queue up around 50,000 FlowFiles on each node. Change connection's Load Balance Strategy from "Do Not Load Balance" to "Round Robin." This results in the data that is swapped out not getting swapped back in.

Issue Links

• links to: GitHub Pull Request #3473