Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-24630

SPIP: Support SQLStreaming in Spark

    XMLWordPrintableJSON

Details

    Description

      At present, KafkaSQL, Flink SQL(which is actually based on Calcite), SQLStream, StormSQL all provide a stream type SQL interface, with which users with little knowledge about streaming,  can easily develop a flow system processing model. In Spark, we can also support SQL API based on StructStreamig.

      To support for SQL Streaming, there are two key points: 
      1, Analysis should be able to parse streaming type SQL. 
      2, Analyzer should be able to map metadata information to the corresponding 
      Relation. 

      Attachments

        1. SQLStreaming SPIP V2.pdf
          142 kB
          Jackey Lee

        Activity

          People

            Unassigned Unassigned
            Jackey Lee Jackey Lee
            Votes:
            3 Vote for this issue
            Watchers:
            28 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: