[SPARK-12225] Support adding or replacing multiple columns at once in DataFrame API

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 1.5.2
• Component/s: SQL
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Sun Rui
• Created: 09/Dec/15 02:20
• Updated: 12/Dec/22 18:10
• Resolved: 21/May/19 04:13

Description

Currently, withColumn() method of DataFrame supports adding or replacing only single column. It would be convenient to support adding or replacing multiple columns at once.

Also withColumnRenamed() supports renaming only single column.It would also be convenient to support renaming multiple columns at once.

Issue Links

• is related to: SPARK-20542 Add an API into Bucketizer that can bin a lot of columns all at once
• relates to: SPARK-12235 Enhance mutate() to support replace existing columns