[GOBBLIN-2062] adhoc flow failure due to concurrent execs must be removed from flow catalog

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: gobblin-service
• Assignee: Abhishek Tiwari
• Reporter: Kip Kohn
• Created: 06/May/24 19:57
• Updated: 12/Jun/24 01:41

Description

the Orchestrator + DagManager MUST remove adhoc flows that violate concurrent execs from the flow catalog. otherwise gaas will continue to return '409 Conflict' to each subsequent attempt to create an adhoc flow with the same flowGroup+flowName. this is despite the fact that the flow (which still remains in the FlowCatalog, when it shouldn't be) already has the status FAILED, which is a "final status".