We have 6 connectors under distributed Kafka worker. Each of these connectors has 18-36 tasks. Each time we add new connector all existing connectors restarts/re-balance.
- For each new connector we add, previous/existing connector(s) restarts along with new connector.
- All existing connectors and their tasks goes into re-balance mode.
Assuming that we want to add 3 new connectors in one flow or call, how can we do that in one HTTP call rather than 3 HTTP POST calls. Because after each HTTP call we have to wait for re-balance to finish and wait for all tasks to be up again across all instances.
Is there any way to create all these 3 connectors for same distributed worker in one HTTP call?
If not, can we add this as a improvement?