Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
Given that many sets of plugins (e.g. LLAP) come as a package deal and do not work without each other, it would make sense for them to be aware of each other.
Not sure yet of the best way for this to work, we probably don't want too much complexity, dependency systems, etc. Perhaps after all the plugins are initialized fully, an optional-to-implement call could be made to each of them passing a map from plugin type (communicator, scheduler, etc.) to the instance that is going to be used for this DAG.