[NEMO-206] Efficient Broadcast Variable Serialization

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Labels: runtime
• Assignee: Unassigned
• Reporter: John Yang
• Created: 29/Aug/18 11:14
• Updated: 29/Aug/18 11:15

Description

For simplicity we are assuming broadcast variables to be Java 'Serializable'. To handle large broadcast variables efficiently, we should instead use more efficient serializers such as Kryo(as in Spark).