Uploaded image for project: 'Apache Gearpump'
  1. Apache Gearpump
  2. GEARPUMP-27

Dynamic DAG modification API

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • streaming
    • None

    Description

      Dynamic modification of running DAG through API needed to support other application utilize Gearpump as a real stream processing 'engine', because most of business application has it's own UI's and modification of running DAG issued from business application not by developer or Gearpump admin.

      It's same for me. I'm developing business application with it's own UI but has requirements of dynamic change of DAG.

      My current approach is to dynamically generate akka streams based class (with connection information) and load it using loadClass. But if gearpump provides those kind of APIs, it might be very helpful.

      The use case might user change processing logic of data stream by selecting an item from combo box of my UI, and my application dynamically compose new logic and pass the compiled jar (or just source code) to the API which gearpump provides.

      Attachments

        Activity

          People

            Unassigned Unassigned
            wingsof JongHyok Lee
            Votes:
            2 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: