[KAFKA-3993] Console producer drops data

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.10.0.0
• Component/s: clients
• Assignee: Unassigned
• Reporter: Roger Hoover
• Created: 26/Jul/16 18:08
• Updated: 06/Oct/16 17:40
• Resolved: 26/Aug/16 18:51

Description

The console producer drops data when if the process exits too quickly. I suspect that the shutdown hook does not call close() or something goes wrong during that close().

Here's a simple to illustrate the issue:

export BOOTSTRAP_SERVERS=localhost:9092
export TOPIC=bar
export MESSAGES=10000
./bin/kafka-topics.sh --zookeeper localhost:2181 --create --partitions 1 --replication-factor 1 --topic "$TOPIC" \
&& echo "acks=all" > /tmp/producer.config \
&& echo "linger.ms=0" >> /tmp/producer.config \
&& seq "$MESSAGES" | ./bin/kafka-console-producer.sh --broker-list "$BOOTSTRAP_SERVERS" --topic "$TOPIC" --producer-config /tmp/producer.config \
&& ./bin/kafka-console-consumer.sh --bootstrap-server "$BOOTSTRAP_SERVERS" --new-consumer --from-beginning --max-messages "${MESSAGES}" --topic "$TOPIC"

Issue Links

• duplicates: KAFKA-3129 Console producer issue when request-required-acks=0
• links to: GitHub Pull Request #1667