[SPARK-19365] Optimize RequestMessage serialization

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.2.0
• Assignee: Shixiong Zhu
• Reporter: Shixiong Zhu
• Created: 26/Jan/17 01:50
• Updated: 27/Jan/17 23:08
• Resolved: 27/Jan/17 23:08

Description

Right now Netty PRC serializes RequestMessage using Java serialization, and the size of a single message (e.g., RequestMessage(..., "hello!")`) is about 1kb.

This PR optimizes it by serializing RequestMessage manually, and reduces the above message size to 100+ bytes.

Issue Links

• links to: [Github] Pull Request #16706 (zsxwing)