Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-8120

Getting NegativeArraySizeException when using Kafka Connect to send data to Kafka

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.1.1, 2.5.0
    • None
    • connect
    • None
    • Ubuntu 16.04 LTS
    • Patch, Important

    Description

       

      I have a large MongoDump JSON which I tried pushing to Kafka using Kafka Connect.

      I am getting the following Exception after around 16k messages been pushed. After the exception, the program doesn't get killed or exit, but now no more messages are pushed.

      [2019-03-15 08:48:13,812] ERROR WorkerSourceTask{id=od-test18-0} Task threw an uncaught and unrecoverable exception (org.apache.kafka.connect.runtime.WorkerTask:177) java.lang.NegativeArraySizeException at org.apache.kafka.connect.file.FileStreamSourceTask.poll(FileStreamSourceTask.java:141) at org.apache.kafka.connect.runtime.WorkerSourceTask.poll(WorkerSourceTask.java:244) at org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:220) at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:175) at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:219) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) [2019-03-15 08:48:13,814] ERROR WorkerSourceTask{id=od-test18-0} Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask:178)

       

      Attachments

        1. test.txt
          18 kB
          Jun Wang
        2. gen-mongodump.sh.txt
          0.2 kB
          Jun Wang

        Activity

          People

            wj1918 Jun Wang
            coolboi567 Prashant Shahi
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: