[SPARK-11860] Invalid argument specification for registerFunction [Python]

• Type: Documentation
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 1.5.2
• Fix Version/s: 1.6.0
• Component/s: Documentation, PySpark
• Assignee: Jeff Zhang
• Reporter: Tristan
• Created: 19/Nov/15 20:43
• Updated: 25/Nov/15 13:51
• Resolved: 25/Nov/15 13:50

Description

https://github.com/apache/spark/blob/branch-1.5/python/pyspark/sql/context.py#L171-L178

Documentation for SQLContext.registerFunction specifies a lambda function as input. This is false (it works fine with non-lambda functions). I believe this is a typo based on the presence of 'samplingRatio' in the parameter docs:

https://github.com/apache/spark/blob/branch-1.5/python/pyspark/sql/context.py#L178

Issue Links

• links to: [Github] Pull Request #9901 (zjffdu)