[KAFKA-1532] Move CRC32 to AFTER the payload

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: core, producer
• Assignee: Jun Rao
• Reporter: Julian Morrison
• Created: 09/Jul/14 13:41
• Updated: 09/Jul/14 22:03

Description

To support streaming a message of known length but unknown content, take the CRC32 out of the message header and make it a message trailer. Then client libraries can calculate it after streaming the message to Kafka, without materializing the whole message in RAM.