[SPARK-4505] Reduce the memory usage of CompactBuffer[T] when T is a primitive type

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 1.3.0
• Component/s: Spark Core
• Assignee: Shixiong Zhu
• Reporter: Shixiong Zhu
• Created: 20/Nov/14 05:51
• Updated: 30/Nov/14 01:23
• Resolved: 30/Nov/14 01:23

Description

If CompactBuffer has a ClassTag parameter, CompactBuffer can create primitive arrays for primitive types. It will reduce the memory usage for primitive types significantly and only pay minor performance lost.

Issue Links

• links to: [Github] Pull Request #3378 (zsxwing)