[SPARK-9469] TungstenSort should not do safe -> unsafe conversion itself

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: SQL
• Target Version/s: 1.5.0
• Assignee: Reynold Xin
• Reporter: Reynold Xin
• Created: 30/Jul/15 05:36
• Updated: 31/Jul/15 00:17
• Resolved: 31/Jul/15 00:17

Description

TungstenSort itself assumes input rows are safe rows, and uses a projection to turn the safe rows into UnsafeRows. We should take that part of the logic out of TungstenSort, and let the planner take care of the conversion. In that case, if the input is UnsafeRow already, no conversion is needed.

Issue Links

• links to: [Github] Pull Request #7781 (rxin)
• links to: [Github] Pull Request #7803 (rxin)