[SPARK-43363] Remove a workaround for pandas categorical type for pyarrow

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.5.0
• Component/s: PySpark
• Assignee: Takuya Ueshin
• Reporter: Takuya Ueshin
• Created: 04/May/23 00:00
• Updated: 05/May/23 00:54
• Resolved: 05/May/23 00:54

Description

Now that the minimum version of pyarrow is 1.0.0, a workaround for pandas' categorical type for pyarrow can be removed.