[KAFKA-2137] New Kafka Producer not fully asynchronous

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Assignee: Unassigned
• Reporter: David Hay
• Created: 21/Apr/15 15:40
• Updated: 21/Apr/15 16:14
• Resolved: 21/Apr/15 16:14

Description

The new Producer client attempts to be fully asynchronous. However, it sill has the potential to block at the start of the send method when it asks for the metadata for the topic. (waitOnMetadata(record.topic(), this.metadataFetchTimeoutMs))

There is a timeout (60 seconds, by default), but it would be nice if this lookup was performed in the background thread as well. This way producers could fire and forget without any potential to block the sending thread.

Issue Links

• duplicates: KAFKA-1835 Kafka new producer needs options to make blocking behavior explicit