Details
-
Sub-task
-
Status: In Progress
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
Today it is possible to add operators to a running application from the CLI/client. It should be possible to do this from within the application also. This can be used to expand/remove a Sub-DAG on demand, triggered by application specific logic. It will enable use cases such as batch applications that perform multiple stages of processing where not all resources are required at the same time or the logic of subsequent steps depends on the execution of previous steps.