[SPARK-42002] Implement DataFrameWriterV2 (ReadwriterV2Tests) - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: 3.4.0
Fix Version/s: 3.4.0
Component/s: Connect
Labels:
None

Description

pyspark/sql/tests/test_readwriter.py:182 (ReadwriterV2ParityTests.test_api)
self = <pyspark.sql.tests.connect.test_parity_readwriter.ReadwriterV2ParityTests testMethod=test_api>

    def test_api(self):
        df = self.df
>       writer = df.writeTo("testcat.t")

../test_readwriter.py:185: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = DataFrame[key: bigint, value: string], args = ('testcat.t',), kwargs = {}

    def writeTo(self, *args: Any, **kwargs: Any) -> None:
>       raise NotImplementedError("writeTo() is not implemented.")
E       NotImplementedError: writeTo() is not implemented.

../../connect/dataframe.py:1529: NotImplementedError