[SPARK-10621] Audit function names in FunctionRegistry and corresponding method names shown in functions.scala and functions.py

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.6.0
• Component/s: SQL
• Target Version/s: 1.6.0
• Assignee: Reynold Xin
• Reporter: Yin Huai
• Created: 15/Sep/15 18:23
• Updated: 25/Nov/15 21:20
• Resolved: 25/Nov/15 05:31

Description

Right now, there are a few places that we are not very consistent.

• There are a few functions that are registered in FunctionRegistry, but not provided in functions.scala and functions.py. Examples are isnull and get_json_object.
• There are a few functions that we have different names in FunctionRegistry and method name in DataFrame API. spark_partition_id is an example. In FunctionRegistry, it is called spark_partition_id. But, DataFrame API, the method is called sparkPartitionId.

Issue Links

• links to: [Github] Pull Request #9948 (rxin)
• links to: [Github] Pull Request #9977 (gatorsmile)