[SPARK-21633] Unary Transformer in Python

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.2.0
• Fix Version/s: 2.3.0
• Component/s: ML
• Assignee: Ajay Saini
• Reporter: Ajay Saini
• Shepherd: Joseph K. Bradley
• Created: 04/Aug/17 02:15
• Updated: 04/Aug/17 08:02
• Resolved: 04/Aug/17 08:02

Description

Currently, the abstract class UnaryTransformer is only implemented in Scala. In order to make Pyspark easier to extend with custom transformers, it would be helpful to have the implementation of UnaryTransformer in Python as well.

This task involves:

• implementing the class UnaryTransformer in Python
• testing the transform() functionality of the class to make sure it works