Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-275

Add SpringXD interpreter

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.6.0
    • Fix Version/s: None
    • Component/s: Interpreters
    • Labels:

      Description

      SpringXD is a unified, distributed, and extensible runtime platform for data ingestion, real time analytics, batch processing, and data export. It simplifies the development of big data applications.

      Spring XD provides an extensible DSL for defining a stream and jobs using pipes and filters abstraction. A simple linear stream consists of a sequence of modules. Typically an Input Source, (optional) Processing Steps, and an Output Sink.

      DSL example for defaing a stream that collects data from an HTTP Source and writes it into a HDFS Sink

      http --port 9000 | hdfs --fileName=<hdfs file name>
      

      or twitter search stream that stores the incoming tweets in memory grid like Geode:

      twittersearch --query=Zeppelin --outputType=application/json | gemfire-json-server --host=... --port=... --regionName=... --keyExpression=payload.getField('id_str')
      

      The Spring XD DSL is good fit for Zeppelin notebooks as it will allow to declaratively (and human readably) define the ingestion/processing/export pipelines.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                tzolov Christian Tzolov
                Reporter:
                tzolov Christian Tzolov
              • Votes:
                1 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated: