[KAFKA-5059] Implement Transactional Coordinator

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.11.0.0
• Component/s: core
• Assignee: Damian Guy
• Reporter: Damian Guy
• Created: 12/Apr/17 13:53
• Updated: 31/May/17 06:44
• Resolved: 31/May/17 06:44

Description

This covers the implementation of the transaction coordinator to support transactions, as described in KIP-98: https://cwiki.apache.org/confluence/display/KAFKA/KIP-98+-+Exactly+Once+Delivery+and+Transactional+Messaging

Issue Links

• links to: GitHub Pull Request #2846
• links to: GitHub Pull Request #2849
• links to: GitHub Pull Request #2934

Sub-Tasks

• TransactionCoordinator - Check inter broker protocol and message format and raise errors if incompatible: Resolved
• Change InterBrokerSendThread to use a Queue per broker: Resolved
• TransactionCoordinator - Add ACL check for each request: Resolved
• WriteTxnMarkers and complete commit/abort on partition immigration: Resolved
• Abort long running transactions: Resolved
• Move coordinatorEpoch from WriteTxnMarkerRequest to TxnMarkerEntry: Resolved
• Refactor TransactionCoordinator in-memory structure and error handling logic: Resolved
• Cleanup delayed produce purgatory during partition emmigration: Resolved
• TC should not accept empty string transactional id: Resolved
• Move transaction expiration logic and scheduling to the Transaction Manager: Open