Uploaded image for project: 'Metron (Retired)'
  1. Metron (Retired)
  2. METRON-2157

To better abstract the streaming infrastructure, use Apache Beam.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: To Do
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      Apache Beam is "[a]n advanced unified programming model" that can "Implement batch and streaming data processing jobs that run on any execution engine" (according to their [docs|https://beam.apache.org/). 

      If Metron were to use such an abstraction, there could be greater portability between different offerings of streaming infrastructure (Spark, Flink etc).

      Attachments

        Activity

          People

            Unassigned Unassigned
            ph1ll1phenry Phillip Henry
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: