[SPARK-9108] Expose Kryo serializer buffer size

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Component/s: Spark Core
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Zhang, Liye
• Created: 16/Jul/15 15:42
• Updated: 21/May/19 04:36
• Resolved: 21/May/19 04:36

Description

Spark serializer may also use a plenty of memory, for Kryo default, the buffer is upto 2GB. It would be better to expose how much memory is used by this part.