[SPARK-8070] Improve createDataFrame in Python

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: PySpark
• Target Version/s: 1.5.0
• Assignee: Davies Liu
• Reporter: Davies Liu
• Created: 03/Jun/15 07:12
• Updated: 29/Jun/15 20:20
• Resolved: 29/Jun/15 20:20

Description

Currently, createDataFrame will issue multiple jobs in Spark (mostly are small jobs of take()), but it's still better to avoid them if possible.

Issue Links

• links to: [Github] Pull Request #6606 (davies)