[KAFKA-5527] Idempotent/transactional Producer part 2 (KIP-98)

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Ismael Juma
• Created: 27/Jun/17 14:17
• Updated: 17/Feb/19 19:02

Description

KAFKA-4815 tracks the items that were included in 0.11.0.0. This JIRA is for tracking the ones that did not make it. Setting "Fix version" to 0.11.1.0, but that is subject to change.

Sub-Tasks

• LogCleaner tests to verify behaviour of message format v2: Reopened
• TransactionManager should send and `AddOffsetsToTxn` request only once per group per transaction: Open
• Suggested clean-ups from message format V2 review: Open
• DebuggingConsumerId and DebuggingMessageFormatter and message format v2: Open
• FetchRequestTest should use batches with more than one message: Open
• Remove cyclic dependency between record and protocol packages: Open
• Improve CRC tests so that we verify which fields are included in the CRC: Open
• Add tools and metrics to diagnose problems with the idempotent producer and transactions: Open
• Producer should await transaction completion in close: Open
• Distinguish abortable failures in transactional producer: Resolved
• OutOfSequence error should be fatal: Open
• Producer with transactionalId should be able to send outside of a transaction: Open
• Additional Test Cases for ReplicaManager: Open
• Fix transaction marker grouping by producerId in TC: Open
• TransactionsTest.testFencingOnAddPartitions Timeout: Open
• Idempotent producer ignores shutdown while fetching ProducerId: Resolved
• ListOffset should take LSO into account when searching by timestamp: Resolved
• Look into making acks=all the default setting: Resolved
• Develop and understanding of how to tune transactions for optimal performance: Open