[SPARK-6367] Use the proper data type for those expressions that are hijacking existing data types.

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4.0
• Component/s: SQL
• Target Version/s: 1.4.0
• Assignee: Yin Huai
• Reporter: Yin Huai
• Created: 16/Mar/15 23:37
• Updated: 12/Apr/15 02:35
• Resolved: 12/Apr/15 02:35

Description

For the following expressions, the actual value type does not match the type of our internal representation.
ApproxCountDistinctPartition
NewSet
AddItemToSet
CombineSets
CollectHashSet

We should create UDTs for data types of these expressions.

Issue Links

• blocks: SPARK-6368 Build a specialized serializer for Exchange operator.
• links to: [Github] Pull Request #5094 (yhuai)