[SPARK-27656] Safely register class for GraphX

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 2.4.3
• Component/s: GraphX
• Assignee: Unassigned
• Reporter: Ruifeng Zheng
• Created: 08/May/19 10:18
• Updated: 26/Jun/19 01:58
• Resolved: 26/Jun/19 01:58

Description

GraphX common classes (such as: Edge, EdgeTriplet) are not registered in Kryo by default.

Users can register those classes via GraphXUtils.registerKryoClasses, however, it seems that none graphx-lib impls call it, and users tend to ignore this registration.

So I prefer to safely register them in KryoSerializer.scala, like what  SQL and ML do.

 

Issue Links

• links to: GitHub Pull Request #24555