[KAFKA-3713] test_producer_throughput is failing with compression_type=snappy

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.10.0.0
• Component/s: clients
• Assignee: Ismael Juma
• Reporter: Ismael Juma
• Created: 14/May/16 03:29
• Updated: 17/May/16 13:54
• Resolved: 14/May/16 04:04

Description

The failure only happens for certain message sizes and they started after the recent change to use the default buffer size from each compression library (https://github.com/apache/kafka/commit/1182d61deb23b5cd86cbe462471f7df583a796e1).

Looking at the heap dump, it seems like there is one or more memory leaks and the larger buffer size increases their impact. I found and fixed one, but still testing to see if that fixes the problem.

System test results can be found here:

http://confluent-kafka-system-test-results.s3-us-west-2.amazonaws.com/2016-05-12--001.1463071628--apache--trunk--84d17bd/report.html