[SPARK-46619] Implement the missing Pandas API methods

• Type: Umbrella
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 4.0.0
• Component/s: Connect, PS
• Assignee: Unassigned
• Reporter: Ruifeng Zheng
• Created: 08/Jan/24 09:22
• Updated: 08/Jan/24 09:22

Sub-Tasks

• Introduce a basic fallback mechanism for frame methods: Resolved
• Specify the return type to avoid schema inference: Open
• Add `convert_dtypes`, `infer_objects` and `set_axis` in fallback list: Resolved
• Implement {Frame, Series}.to_hdf: Resolved
• implement `Frame.to_feather`: Resolved
• Implement `Frame.to_stata`: Resolved
• Support dedicated fallback methods: Resolved
• Implement `DataFrameGroupBy.corr`: Resolved