[CONNECTORS-780] For scalability/reliability, allow multiple agents processes to run at the same time

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: ManifoldCF 1.4
• Fix Version/s: ManifoldCF 1.5
• Assignee: Karl Wright
• Reporter: Karl Wright
• Created: 23/Sep/13 09:26
• Updated: 22/Nov/13 16:14
• Resolved: 13/Nov/13 08:11

Description

Today the *Stuffer threads basically know they are unique; this permits them to avoid throwing huge numbers of locks on every iteration. Those cannot therefore be replicated at this time. A good deal of experimentation and/or potential schema changes will be needed to solve this issue - or, possibly, using outside locks to prevent more than one stuffing operation from proceeding at the same time. Also, throttling is meaningless if there are multiple independent ManifoldCF instances in different processes that are unaware of each other - throttling would therefore need to be handled in a way that used the services of ILockManager rather than native synchronizers in order to be scalable in the right way.

This is related to CONNECTORS-13 and CONNECTORS-286.

Issue Links

• duplicates: CONNECTORS-781 Fault-Tolerant Setup for ManifoldCF Agent.