[SPARK-25430] Add map parameter for withColumnRenamed

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 2.3.1
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Goun Na
• Created: 14/Sep/18 08:48
• Updated: 12/Dec/22 18:10
• Resolved: 12/Jan/19 16:26

Description

WithColumnRenamed method should work with map parameter. It removes code redundancy.

// example
df.withColumnRenamed(Map( "c1" -> "first_column", "c2" -> "second_column" ))

// from abbr columns to desc columns
val m = Map( "c1" -> "first_column", "c2" -> "second_column" )
df1.withColumnRenamed(m) 
df2.withColumnRenamed(m)

It is useful for CJK users when they are working on analysis in notebook environment such as Zeppelin, Databricks, Apache Toree. 

// for CJK users once define dictionary into map, reuse column map to translate columns whenever report visualization is required
val m = Map( "c1" -> "컬럼_1", "c2" -> "컬럼_2") 
df1.withColumnRenamed(m) 
df2.withColumnRenamed(m)

Issue Links

• is duplicated by: SPARK-25571 Add withColumnsRenamed method to Dataset
• links to: [Github] Pull Request #22428 (goungoun)
• links to: GitHub Pull Request #22428