[SAMZA-1659] Making user functions serializable in high-level APIs

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.15.0
• Labels: fluent-api
• Assignee: Yi Pan
• Reporter: Yi Pan
• Created: 16/Apr/18 04:40
• Updated: 25/May/18 16:39
• Resolved: 25/May/18 16:39

Description

In order to be able to fully serialize the user DAG in high-level APIs, we need to make sure that the user-supplied functions are serializable as well. This will enable:

1. Deserialize and instantiation of per-task user functions become completely managed by the system. No need to invoke StreamApplication.init() in each task
2. Fully serialized user DAG can be distributed across the network to multiple containers

 

Issue Links

• links to: GitHub Pull Request #475