[SPARK-4398] Specialize rdd.parallelize for xrange

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.2.0
• Component/s: PySpark
• Target Version/s: 1.2.0
• Assignee: Xiangrui Meng
• Reporter: Xiangrui Meng
• Created: 14/Nov/14 08:37
• Updated: 14/Nov/14 20:43
• Resolved: 14/Nov/14 20:43

Description

sc.parallelize(range) is slow, which writes to disk. We should specialize xrange for performance.

Issue Links

• links to: [Github] Pull Request #3264 (mengxr)