[SPARK-41829] Implement Dataframe.sort,sortWithinPartitions Ordering

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: Connect
• Assignee: Ruifeng Zheng
• Reporter: Sandeep Singh
• Created: 02/Jan/23 17:37
• Updated: 05/Jan/23 07:27
• Resolved: 05/Jan/23 07:27

Description

File "/Users/s.singh/personal/spark-oss/python/pyspark/sql/connect/dataframe.py", line 422, in pyspark.sql.connect.dataframe.DataFrame.sort
Failed example:
    df.orderBy(["age", "name"], ascending=[False, False]).show()
Exception raised:
    Traceback (most recent call last):
      File "/usr/local/Cellar/python@3.10/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/doctest.py", line 1350, in __run
        exec(compile(example.source, filename, "single",
      File "<doctest pyspark.sql.connect.dataframe.DataFrame.sort[8]>", line 1, in <module>
        df.orderBy(["age", "name"], ascending=[False, False]).show()
    TypeError: DataFrame.sort() got an unexpected keyword argument 'ascending'
**********************************************************************
File "/Users/s.singh/personal/spark-oss/python/pyspark/sql/connect/dataframe.py", line 379, in pyspark.sql.connect.dataframe.DataFrame.sortWithinPartitions
Failed example:
    df.sortWithinPartitions("age", ascending=False)
Exception raised:
    Traceback (most recent call last):
      File "/usr/local/Cellar/python@3.10/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/doctest.py", line 1350, in __run
        exec(compile(example.source, filename, "single",
      File "<doctest pyspark.sql.connect.dataframe.DataFrame.sortWithinPartitions[1]>", line 1, in <module>
        df.sortWithinPartitions("age", ascending=False)
    TypeError: DataFrame.sortWithinPartitions() got an unexpected keyword argument 'ascending'

Issue Links

• links to: [Github] Pull Request #39398 (zhengruifeng)