[FLINK-9700] Document FlinkKafkaProducer behaviour for Kafka versions > 0.11

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.5.0
• Component/s: Connectors / Kafka
• Assignee: leesf
• Reporter: Ufuk Celebi
• Created: 02/Jul/18 09:50
• Updated: 14/Feb/19 02:04
• Resolved: 14/Feb/19 02:04

Description

FlinkKafkaProducer for Kafka 0.11 uses reflection to work around API limitations of the Kafka client. Using reflection breaks with newer versions of the Kafka client (due to internal changes of the client).

The documentation does not mention newer Kafka versions. We should add the following notes:

• Only package Kafka connector with kafka.version property set to 0.11..
• Mention that it is possible to use the 0.11 connector with newer versions of Kafka as the protocol seems to be backwards compatible (double check that this is correct)

Issue Links

• is related to: FLINK-7964 Add Apache Kafka 1.0/1.1 connectors
• relates to: FLINK-9690 Restoring state with FlinkKafkaProducer and Kafka 1.1.0 client fails