Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-33836

Expose DataStreamReader.table and DataStreamWriter.toTable to PySpark

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.2.0
    • 3.1.0
    • Structured Streaming
    • None

    Description

      From SPARK-32885 and SPARK-32896 we added two public APIs to enable read/write with table, but only in Scala side so only JVM languages could leverage them.

      Given there're lots of PySpark users, it would be great to expose these public APIs to PySpark as well.

      Attachments

        Activity

          People

            kabhwan Jungtaek Lim
            kabhwan Jungtaek Lim
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: