[SPARK-2652] Turning default configurations for PySpark

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.2.0
• Component/s: PySpark
• Labels: Configuration Python
• Target Version/s: 1.2.0
• Assignee: Davies Liu
• Reporter: Davies Liu
• Due: 31/Jul/14
• Created: 23/Jul/14 20:10
• Updated: 11/Nov/14 06:23
• Resolved: 24/Oct/14 06:58

Description

Some default value of configuration does not make sense for PySpark, change them to reasonable ones, such as spark.serializer and spark.kryo.referenceTracking

Issue Links

• is related to: SPARK-3990 kryo.KryoException caused by ALS.trainImplicit in pyspark
• links to: [Github] Pull Request #1568 (davies)
• links to: [Github] Pull Request #2916 (davies)
• links to: [Github] Pull Request #3187 (mengxr)