[FLINK-4035] Add Apache Kafka 0.10 connector

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.0.3
• Fix Version/s: 1.2.0
• Component/s: Connectors / Kafka
• Assignee: Robert Metzger
• Reporter: Elias Levy
• Created: 08/Jun/16 21:01
• Updated: 11/Oct/16 08:14
• Resolved: 11/Oct/16 08:06

Description

Kafka 0.10.0.0 introduced protocol changes related to the producer. Published messages now include timestamps and compressed messages now include relative offsets. As it is now, brokers must decompress publisher compressed messages, assign offset to them, and recompress them, which is wasteful and makes it less likely that compression will be used at all.

Issue Links

• is duplicated by: FLINK-4629 Kafka v 0.10 Support
• links to: GitHub Pull Request #2231
• links to: GitHub Pull Request #2369