[SPARK-21193] Specify Pandas version in setup.py

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.2.0
• Fix Version/s: 2.3.0
• Component/s: PySpark
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 23/Jun/17 10:41
• Updated: 12/Dec/22 17:50
• Resolved: 23/Jun/17 13:52

Description

It looks we don't specify Pandas version in https://github.com/apache/spark/blob/master/python/setup.py#L202. It looks few versions do not work with Spark anymore. It might be better to explicitly set this.

Issue Links

• links to: [Github] Pull Request #18403 (HyukjinKwon)