Details
-
Documentation
-
Status: Open
-
Critical
-
Resolution: Unresolved
-
1.7.0
-
None
-
CentOS release 6.4 (Final)
-
Important
Description
REF: https://archive.cloudera.com/cdh5/cdh/5/flume-ng/FlumeUserGuide.html#kafka-sink
Original in example:
a1.sinks.k1.channel = c1
a1.sinks.k1.type = org.apache.flume.sink.kafka.KafkaSink
a1.sinks.k1.kafka.topic = mytopic
a1.sinks.k1.kafka.bootstrap.servers = localhost:9092
a1.sinks.k1.kafka.flumeBatchSize = 20
a1.sinks.k1.kafka.producer.acks = 1
a1.sinks.k1.kafka.producer.linger.ms = 1
a1.sinks.ki.kafka.producer.compression.type = snappy
a1.sinks.k1.kafka.flumeBatchSize doesn't make any sense, the batch size will be set to default (100), after I change it to:
a1.sinks.k1.flumeBatchSize = 20
everything works fine