Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-24630

SPIP: Support SQLStreaming in Spark

    Details

    • Type: Improvement
    • Status: In Progress
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 2.2.0, 2.2.1
    • Fix Version/s: None
    • Component/s: Structured Streaming
    • Labels:

      Description

      At present, KafkaSQL, Flink SQL(which is actually based on Calcite), SQLStream, StormSQL all provide a stream type SQL interface, with which users with little knowledge about streaming,  can easily develop a flow system processing model. In Spark, we can also support SQL API based on StructStreamig.

      To support for SQL Streaming, there are two key points: 
      1, Analysis should be able to parse streaming type SQL. 
      2, Analyzer should be able to map metadata information to the corresponding 
      Relation. 

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Jackey Lee Jackey Lee
            • Votes:
              3 Vote for this issue
              Watchers:
              24 Start watching this issue

              Dates

              • Created:
                Updated: