Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-40940

Fix the unsupported ops checker to allow chaining of stateful operators

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0
    • 3.4.0
    • Structured Streaming
    • None

    Description

      This is follow up ticket on https://issues.apache.org/jira/browse/SPARK-40925 - once we allow chaining of stateful operators in Spark SS, we need to fix the unsupported ops checker to allow these (currently they are blocked and require setting spark.sql.streaming.unsupportedOperationCheck to false

      Attachments

        Activity

          People

            WweiL Wei Liu
            alex-balikov Alex Balikov
            Jungtaek Lim Jungtaek Lim
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: