P3 Description
It would be nice to be able to launch dataflow pipelines in parallel.
For example, here is my use case:
- I consume data produced by my clients/customers.
- I need to launch a pipeline on an event dispatch.
- I may receive multiple events, from multiple customers at the same time.
- Go code could be simpler if synchronization/cooperation wouldn't be needed from goroutines handling each customer. In particular, setting options through flags is cumbersome.
- Launching dataflow pipelines serially may not scale if I am able to sign up many customers.