[KAFKA-5795] Make the idempotent producer the default producer setting

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Apurva Mehta
• Reporter: Apurva Mehta
• Created: 26/Aug/17 03:01
• Updated: 17/Feb/19 18:57

Description

We would like to turn on idempotence by default. The KIP is here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-185%3A+Make+exactly+once+in+order+delivery+per+partition+the+default+producer+setting

Sub-Tasks

• Idempotent producer should not require max.in.flight.requests.per.connection=1: Resolved
• Tighten up situations where OutOfOrderSequence may be returned: Resolved
• Introduce new idempotence mode to gracefully deal with topics on the older message format: Open
• Understand performance implications of acks=all and potential ways to reduce it: Open
• Transactions system test should check for message order: Resolved
• Add `hasOffset` and `hasTimestamp` methods to RecordMetadata to indicate whether metadata is available: Resolved
• Return MessageFormatVersion and MessageMaxBytes in MetadataResponse: Patch Available