[HADOOP-14623] fixed some bugs in KafkaSink

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0-alpha3
• Component/s: common, tools
• Assignee: Hongyuan Li
• Reporter: Hongyuan Li
• Created: 05/Jul/17 07:56
• Updated: 02/Oct/19 17:14

Description

KafkaSink#init should set ack to 1 to make sure the message has been written to the broker at least.

current code list below:

  
    props.put("request.required.acks", "0");

Update

find another bug about this class, key.serializer used org.apache.kafka.common.serialization.ByteArraySerializer, however, the key properties of Producer is Integer, codes list below:

    props.put("key.serializer",
        "org.apache.kafka.common.serialization.ByteArraySerializer");
……………
 producer = new KafkaProducer<Integer, byte[]>(props);

Issue Links

• relates to: HADOOP-10949 metrics2 sink plugin for Apache Kafka