[REEF-1004] Define Avro schema for Vortex messages

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.14
• Component/s: Vortex
• Assignee: Yunseong Lee
• Reporter: Yunseong Lee
• Created: 21/Nov/15 13:07
• Updated: 07/Dec/15 01:23
• Resolved: 07/Dec/15 01:23

Description

Current Vortex uses org.apache.commons.lang.SerializationUtils for (de-)serializing messages between VortexMaster and VortexWorkers. We can make it efficient by using Avro.

For VortexFunction, Input, and Output, they can be set as bytes (byte[]) and (de-)serialized outside Avro for now. The types may be changed as how other parts serialize/deserialize the data (e.g., If we follow REEF-1003, then the field would be string).

Issue Links

• is part of: REEF-504 Clean up Serializable in Vortex