[KAFKA-6927] Broker uses significant amount of memory during down-conversion

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: core
• Assignee: Dhruvil Shah
• Reporter: Dhruvil Shah
• Reviewer: Jason Gustafson
• Created: 21/May/18 21:06
• Updated: 01/Jun/18 10:14
• Resolved: 01/Jun/18 10:14

Description

Kafka broker could consume significant amount of memory when down-conversion is required. We have seen scenarios where this causes out of memory errors. This issue and the proposed fix is described in detail in KIP-283 - https://cwiki.apache.org/confluence/display/KAFKA/KIP-283%3A+Efficient+Memory+Usage+for+Down-Conversion

 

Issue Links

• links to: GitHub Pull Request #4871
• mentioned in: Page Loading...
• mentioned in: Page Loading...

Sub-Tasks

• Add configuration to disable message down-conversion: Resolved