Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-21765

Ensure all leaf nodes that are derived from streaming sources have isStreaming=true

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.2.0
    • Fix Version/s: 2.3.0
    • Component/s: SQL, Structured Streaming
    • Labels:
      None

      Description

      LogicalPlan has an isStreaming bit, but it's incompletely implemented. Some streaming sources don't set the bit, and the bit can sometimes be lost in rewriting. Setting the bit for all plans that are logically streaming will help us simplify the logic around checking query plan validity.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                joseph.torres Jose Torres
                Reporter:
                joseph.torres Jose Torres
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: