Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-24630

SPIP: Support SQLStreaming in Spark

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: In Progress
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 2.2.0, 2.2.1
    • Fix Version/s: None
    • Component/s: Structured Streaming
    • Labels:

      Description

      At present, KafkaSQL, Flink SQL(which is actually based on Calcite), SQLStream, StormSQL all provide a stream type SQL interface, with which users with little knowledge about streaming,  can easily develop a flow system processing model. In Spark, we can also support SQL API based on StructStreamig.

      To support for SQL Streaming, there are two key points: 
      1, Analysis should be able to parse streaming type SQL. 
      2, Analyzer should be able to map metadata information to the corresponding 
      Relation. 

        Attachments

        1. SQLStreaming SPIP V2.pdf
          142 kB
          Jackey Lee

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Jackey Lee Jackey Lee
            • Votes:
              3 Vote for this issue
              Watchers:
              28 Start watching this issue

              Dates

              • Created:
                Updated: