[SPARK-21030] extend hint syntax to support any expression for Python and R

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Done
• Affects Version/s: 2.2.0
• Component/s: PySpark, SparkR, SQL
• Assignee: Unassigned
• Reporter: Felix Cheung
• Created: 09/Jun/17 04:40
• Updated: 01/Dec/18 02:40
• Resolved: 01/Dec/18 02:40

Description

See SPARK-20854
we need to relax checks in
https://github.com/apache/spark/blob/6cbc61d1070584ffbc34b1f53df352c9162f414a/python/pyspark/sql/dataframe.py#L422

and
https://github.com/apache/spark/blob/7f203a248f94df6183a4bc4642a3d873171fef29/R/pkg/R/DataFrame.R#L3746

Issue Links

• links to: [Github] Pull Request #20788 (DylanGuedes)

Sub-Tasks

• extend hint syntax to support any expression for Python: Resolved
• extend hint syntax to support any expression for R: Resolved