[SPARK-28174] Upgrade to Kafka 2.3.0

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: Build, Structured Streaming
• Assignee: Dongjoon Hyun
• Reporter: Dongjoon Hyun
• Created: 26/Jun/19 19:28
• Updated: 27/Jun/19 14:53
• Resolved: 27/Jun/19 14:50

Description

This issue updates Kafka dependency to 2.3.0 to bring the following 9 client-side patches at least.

• https://issues.apache.org/jira/issues/?jql=project%20%3D%20KAFKA%20AND%20fixVersion%20%3D%202.3.0%20AND%20fixVersion%20NOT%20IN%20(2.2.0%2C%202.2.1)%20AND%20component%20%3D%20clients

The following is a full release note.

• https://www.apache.org/dist/kafka/2.3.0/RELEASE_NOTES.html

Issue Links

• relates to: SPARK-26267 Kafka source may reprocess data
• links to: GitHub Pull Request #24976