[SPARK-9014] Allow Python spark API to use built-in exponential operator

• Type: Wish
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.4.0
• Fix Version/s: 1.6.0
• Component/s: PySpark
• Assignee: Alexey Grishchenko
• Reporter: Jon Speiser
• Created: 13/Jul/15 15:39
• Updated: 12/Sep/15 12:56
• Resolved: 11/Sep/15 22:19

Description

It would be nice if instead of saying:

import pyspark.sql.functions as funcs
df = df.withColumn("standarderror", funcs.sqrt(df["variance"]))

...if I could simply say:

df = df.withColumn("standarderror", df["variance"] ** 0.5)

Issue Links

• links to: [Github] Pull Request #8658 (0x0FFF)