[SPARK-9010] Improve the Spark Configuration document about `spark.kryoserializer.buffer`

• Type: Improvement
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 1.4.0
• Fix Version/s: 1.4.2, 1.5.0
• Component/s: Documentation
• Labels: documentation
• Target Version/s: 1.4.2, 1.5.0
• Assignee: StanZhai
• Reporter: StanZhai
• Created: 13/Jul/15 08:46
• Updated: 14/Jul/15 07:57
• Resolved: 14/Jul/15 07:55

Description

The meaning of spark.kryoserializer.buffer should be "Initial size of Kryo's serialization buffer. Note that there will be one buffer per core on each worker. This buffer will grow up to spark.kryoserializer.buffer.max if needed.".

The spark.kryoserializer.buffer.max.mb is out-of-date in spark 1.4.

Issue Links

• links to: [Github] Pull Request #7368 (stanzhai)
• links to: [Github] Pull Request #7393 (stanzhai)