Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14623

fixed some bugs in KafkaSink

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.0.0-alpha3
    • Fix Version/s: None
    • Component/s: common, tools
    • Labels:
      None

      Description

      KafkaSink#init should set ack to 1 to make sure the message has been written to the broker at least.

      current code list below:

        
          props.put("request.required.acks", "0");
      
      

      Update

      find another bug about this class, key.serializer used org.apache.kafka.common.serialization.ByteArraySerializer, however, the key properties of Producer is Integer, codes list below:

          props.put("key.serializer",
              "org.apache.kafka.common.serialization.ByteArraySerializer");
      ……………
       producer = new KafkaProducer<Integer, byte[]>(props);
      

        Attachments

        1. HADOOP-14623-004.patch
          4 kB
          Hongyuan Li
        2. HADOOP-14623-003.patch
          3 kB
          Hongyuan Li
        3. HADOOP-14623-002.patch
          3 kB
          Hongyuan Li
        4. HADOOP-14623-001.patch
          0.8 kB
          Hongyuan Li

          Issue Links

            Activity

              People

              • Assignee:
                Hongyuan Li Hongyuan Li
                Reporter:
                Hongyuan Li Hongyuan Li
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated: