Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-33836

Expose DataStreamReader.table and DataStreamWriter.toTable to PySpark

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.2.0
    • Fix Version/s: 3.1.0
    • Component/s: Structured Streaming
    • Labels:
      None

      Description

      From SPARK-32885 and SPARK-32896 we added two public APIs to enable read/write with table, but only in Scala side so only JVM languages could leverage them.

      Given there're lots of PySpark users, it would be great to expose these public APIs to PySpark as well.

        Attachments

          Activity

            People

            • Assignee:
              kabhwan Jungtaek Lim
              Reporter:
              kabhwan Jungtaek Lim
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: