[KAFKA-2950] Performance regression in producer

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.9.0.1
• Assignee: Unassigned
• Reporter: Jay Kreps
• Created: 05/Dec/15 23:26
• Updated: 05/Dec/15 23:57
• Resolved: 05/Dec/15 23:57

Description

For small messages the producer has gotten slower since the 0.8 release. E.g. for a single thread on linux sending 100 byte messages the decrease seems to be about 30%. The root cause seems to be that the new timeout we added for max.block.ms ends up doing about 4 more system calls to check the ellapsed time.

The reason for these calls is to detect slow serializers or partitioners. But I think this is not worth the performance hit. I think we can say the config is only for blocking due to metadata or memory allocation.