[SPARK-10999] Physical plan node Coalesce should be able to handle UnsafeRow

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.6.0
• Fix Version/s: 1.6.0
• Component/s: SQL
• Target Version/s: 1.6.0
• Assignee: Cheng Lian
• Reporter: Cheng Lian
• Shepherd: Josh Rosen
• Created: 08/Oct/15 06:06
• Updated: 08/Oct/15 16:20
• Resolved: 08/Oct/15 16:20

Description

The following PySpark snippet shows the problem:

>>> sqlContext.range(10).selectExpr('id AS a').coalesce(1).explain(True)
...
== Physical Plan ==
Coalesce 1
 ConvertToSafe
  TungstenProject [id#3L AS a#4L]
   Scan PhysicalRDD[id#3L]

The ConvertToSafe is unnecessary.

Issue Links

• links to: [Github] Pull Request #9024 (liancheng)